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Abstract 

A series of studies designed to address basic questions about instruction in subject areas such as 
science and social studies at the elementary level are described and findings reported. The focus of 
investigation was group discussion of textbook content, and the basic questions addressed concerned 
the effects of instruction in terms of students' knowledge acquisition and their independent reading 
comprehension of novel content. 

Subjects for the studies were fourth g^ade students. Instructional treatment conditions were created to 
distinguish two primary methods of treating text content during class discussion: (a) instruction which 
isolated brief segments of text for oral reading and.subsequent discussion, modeled on conventional 
practice in elementary classrooms and labeled discrete; and (b) instruction which focused on larger 
content units (a subsection rather than a paragraph), designed to promote students' abilities to relate 
information within and aq-oss sections of text, labeled Integrative. An independent reading condition, 
with no instruction, served as a control. 

Students either read silently or participated in teacher-directed instruction, which included guided 
discussion of text content, after reading. The content was a series of 12 articles about three insect 
societies in a specially prepared booklet entitled Insect Societies, discussed and/or read over a 12-day 
instructional period Prior to reading the articles students were administered a series of pretests 
designed to assess domain-spedfic factual knowledge, abilities to use texts as information sources, and 
approach to learning from texts. During the instructional period students completed a daily test of 
knowledge acquired after reading or instruction, without access to the text. These measures assessed' 
understanding of factual information, ability to construct explanations, and application of knowledge in 
new contexts. At the conclusion of the study, alt pretests were administered as^^posttests. Additionklly, 
transfer to independent reading comprehension was assessed through measures constructed for each of 
three passages varying in degree of relatedness to the instructional material 

Principal Ondings indicate that instruction significantly enhances both the amount and kind of 
knowledge students' acquire. Further, Integrate instruction is more effective than Discrete instruction 
with respect to students' knowledge acquisition and independent reading comprehension of both 
related and unrelated material. 
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DISCUSSION, COMPREHENSION, AND KNOWLEDGE 
ACQUISITION IN CONTENT AREA CLASSROOMS 

The-purposc, of the set of studies reported in this article is to increase our understanding of the 
complex set of theoretical and instrucfional issues involved in "reading to learn." Our interest b these 
issues stemmed from an btuition that both teachers and students were commonly frustrated b dealmg 
with tertbook content b subjects like social studies and science. This intuition led us to a series of 
descriptive studies dealing with the structiu-e and content of student textbooks (Gallagher.& Pearson, 
1982) and the apprqaches.teachers used in classrooms to handle texts that are typicallyJoo difficult for 
at least a third of their students to read on their own (Galla^er & Pearson, 1983). 

In our dassroc n work, we learned that teachers at the intermediate level feel an obligation to make 
sure that students get a chance to "hear the content;" hence they engage b round robb oral reading of 
each chapter, stopping eyery. paragraph or two to check comprehension. Most teachers \vish:thal they 
could find alternative approaches to discussion or that they could rely qn:their:students to read and 
learn the information on their own; but, in fairness esped^y to those with modest readbg and 
studybg skills, they revert to the tried and true method of oral reading and recitation. 

These observations came at a time when we were beginning to be iufonhed by research and theory 
from the study of human cognition and the study of the strucliure of prose. From our classroom 
observations we felt, the need to develop and evaluate insthictional alternative's to the conventional 
wisdom. From studies of the structure of-khowledge and text came a framework for. developing these 
isdtematives. Once developed, we carried out a series of three, intervention studies with fourth grade 
students to evaluate the effectiveness of these alternatives. 

A primary assumption undcrlymg our approach, to instructional resea^'ch was that the central goal is tp 
understand the relationship between instructional and cognitive processes. Accordmgly, we attempted 
to explicate die reading process as it is used to acquire knowledge from text. To identify cognitive 
processes thatwould likely be implicated m this type of readbg, we turned to recent work b knowledge 
acquisition, text structure, comprehension, and mjCtacognition as the most likely sources of insight. We 
tried to design a set of bstructional procedures that would foster those processes we had identified. 

As b any btervention study, one must dedde whether to study the impact of key variables by 
manipulatbg them or by studymg the effects of their natural variation tlirough careful measurement. 
Our approach combbes these two strategies. We always directly assessed the impact of our key 
variables; our decisions alout what variables to manipulate were based upon wh.*c we learned at each 
stage of our. reses^ch. 

In the sections that follow, we will cfiscuss the research relevant to both cognitive and instructional 
processes, report our findings from a series of three intervention studies, and discuss the implication^ 
of these findings for the^more general issues mvolved b readbg to learn. 

The Classroom Context and Conventional P^^^ 
Descriptions of Practice 

If we compare the report of Joseph Mayer Rice's early impressions of American classrooms (1893) 
with more recent observational work (Durkin, 1978-^9; Gallagher & Pearson, 1982), we find that, b 
some respects at least, practice has remamed remarkably stable, bdeed resistant to change. In visitbg 
American classrooms Rice observed that a large proportion of time was devoted to the practice of 
"examinbg" students on their mastery of textbook information. Later, Burstall (1909) contrasted 
prevailbg American practice to European practice, commenting that while European teachers tended 
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to lecture more frequently, inviting little ^participation from students, American teachers more often 
acted as meeting chairmen while textbook cbhtcnt was reviewed durmg discussion. 

Not long after Burstairs observations^ Rbmiett Stevens published her work based on observations of 
secoa(lary school classrooms (1910, 1912). From Stevens* work, the democratic meeting chairman 
portrayed by Burstall rccmerges as the adult who dominates instructional time with the initiation and 
control of aJarge proportion of the verbal exchange taking place in classrboms, most of which is rapidly 
paced questions usually requiring verbatim recall, or only a superficial understanding (Stevens, 19i2). 
Stevens' observations confirm Rice's earlier impressions aid dispel Burstail's view of the teacher as a 
democratic facilitator. But, Burstall was correct in observing that American teachers did little 
lecturing; instead, Americaii teachers engaged in a practice that has variously been termed oral 
examination, recitation, or discussion. 

In a thoughtful review of the literature on recitation, Hoetker and Ahlbrand (1969) report that Stevens' 
work stimulated several additional efforts to observe and describe classroom practice. The motivation 
for this was two-fold: first, the characterization of practice emerging from Stevens' work prompted 
others to suspect that Stevens had selected extremely poor teachers to observe; second, the practices 
documented by Stevens were generally regarded as pedagpgiodly unsound. But, later work largely 
confirmed Stevens' findings (Barr, 1929;.Colvin, 1931). Teachers reUed hea>aly on textbooks and spent 
large portions of class time querying the information contained in those textbooks. (For a^ more 
comprehensive treatment of earlier practice, see L. Cuban, 1984, How teachers tau^n.) 

More recent descriptions of on-going instructional practice include those by Smith and Geoffrey 
(1968); Durkin (1978-79), Stodolsky, Ferguson, and Wunpleberg (1981; Stodolsky,, 1988), Gallagher 
and.Pearson (1982); Alvermann, billon, & O'Brien (1987). Smith and Geoffrey's work provides a 
painstaking ethnographic analysis of the events in one classroom. Working vwth inner-city children, the 
teacher adopted the practice, particularly in socialr studies, of devoting class time to what has been 
termed "hearing the textbook.** That, is, the teacher called on one student to read a portion of the 
assigned textbook material aloud. When the student finished, there ensued a brief exchange between 
the teacher and students of the information contained in or relevant to that section of the textbook. 
The lesson then procceded by alternating oral reading and verbal exchange. This practice of "hearing 
the textbook" moves avray from the earlier, more strict form of redtation when teachers called on 
students to recite from memory relevant material from the textbook. As it is still dominated by 
extensive teacher questioning, however (cf. Durkin, 1978-79; Goodlad, 19iS4; Sirotkin, 1083), many 
would be reluctant to grant it the status of true discussion. Nevertheless, as we shall see later, 
practicing teachers regard various forms of "hearing the textbook" as "discussions." 

The work of Stodolsky (1981, 1988) is generally in keeping with the observations of Smith and 
Geoffrey, although Stodolsky and her colleagues distinguish between practice in social studies and 
mathematics classes. They observed several fundamental differences between the two types of classes, 
including grouping (whole or small group), and specific student and teacher behaviors. For our 
purposes, some of the descriptive infofmation the authors report about social studies instruction is 
particularly relevant. Nearly half (i.e;, 44.4%) of the recitation time in social studies at the elementary 
(fifth grade) levcl. was devoted to oral. reading of the textbook and questions and answers. The 
textbook was the dominant material for both students and teachers (teachers relied equally as much on 
the tej^book itself as on the manual accompanying it). 

Consistent with the StodoLsky finding are Durkin's (1978^79), observations of elemental school 
ciassVooms, Durkin was primarily concerned with describing reading instruction, but her work did 
include a more limited set of observations of social studies and science instruction as well. In 
describing instructional practice in content area classrooms Durkm observed that there was very little 
of what she defined as text comprehension instruction, paralleling her findings about reading 
instruction. Rather, practice and assessment (asking questions about text content) emerged as far 
more common activities, with listening and responding to questions bemg the predominating student 
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behaviors. This Durkin attributed to the prevalent practice of allocating instructional time» particularly 
in social studies, to class discussion. Despite the prominence of the text in instruction- (discussion, 
questions and answers concerning the textbook irformation), Durkin reports that she observed no 
instruction aimed at teaching children "how to be better readers of subject area texts'* (Durkin, 1978-79, 
p. 520). 

In a series of observations and follow-up teacher interviews conducted in 30 mtermediate grade social 
studies and science classrooms, Galla^er and Pearson (1982) explored the role of the textbook in 
content area instruction. They concluded that, at least for their sample, content area instruction is 
textbook-dombated, and that this was particularly true m social studies. Though teachers cited the 
value of supplementary films, tapes, and pictures, as well as field trips, class projects, and guest 
speakers, most of the activities observed and the content covered was dictated by the textbook. 

In addition to this very general observation, Gallagher and Pearson were also able to provide some 
descriptive evidence about the prevalent instructional activities, their sequence^ andiormat. Typically 
teachers reported that they spent 2 to 3 weeks on each unit of content, repeatmg the same sequence of 
activities for subsequent units: The teacher introduced the unit; then students read the xmit 
independently; afterwards the teacher and students discussed the unit material, covermg one segment 
per day. Durmg this same time period, students completed independent activities of two types: 
preparmg written responses to teacher-prepared or textbook questions, and completing workbook 
exercises. At the end of the unit, students' mastery of the content was assessed by a test, prepared 
either by the teacher or the textbook publisher. 

The format for unit mtroductiph was most often a discussion, though a few teadiers prepared advance 
organizers or study guides outlining the major topics in the textbook. Next, teachers covered the 
content, by following one or another of a very few formats. By far the most frequently observed format 
was to proceed through that da/s segment of text by reading brief segments orally, stopping to discuss 
the information contained in that section, and then gobg on to read the next section aloud. Other 
formats, each observed rarely in practice, were teacher lecture, student formulation of questions to 
pursue, and discussion organized by teacher-prepared study guides. 

Comparing more recent work with the impressions and observations recorded near the turn of the 
century, we find that m some important respects instructio. il practice has altered very little. The 
textbook continues to dominate. It is the textbook that delbt Ites the knowledge to be acquired. The 
principal instructional activities contbue to focus on the textbook as teachers direct students to first 
read portions of it aloud and then question students about the information contabed m those portions. 
This then :is the context providbg the opportunities for students to acquire.knowledge and develop 
skills to acquire knowledge on their own. 

Evaluations of Practice 

There have been relatively few efforts to evaluate the degree to which the instructional practices just 
described facilitate either knowledge acquisition or reading comprehension, Although such practice 
has been studied, the focus of inquiry has been to characterize the bteraction between teachers and 
students as a social process (Bellack, Jfliebard, Hyman, & Smith, i968; Edwards, 1980, 1981), as havbg 
an underlymg logic (Smith & Meux, 1970; Rosenshbe, 1968), or as an avenue for cognitive 
development (Taba, 1966). In reviewbg classroom bteraction research, Dunkjn and Biddle (1974) 
concluded that while much has been discovered about the processes of teachbg through these studies, 
the implicatioas for student achievement, even b the most general sense, are yet unclear. Fon example, 
although there is evidence that teachers could be trained to adopt many of the practices that Taba 
^^^) advocated, and bdeed altered their practice, these changes m teacher behavior were not 
associated with correspondbg changes in students^ achievement. 
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Although there may be a variety of reasons for the failure to observe a consistent relationship between 
the teacher's practices and students' achievement, there are two which seem particularly relevant. One 
is that achievement has generally been measured in very global terms, perhaps masking some 
instructional effects. The other is that although the central role of the text has been frequently noted, 
the text has not bfluenced either the systems:ff6r characterizing group interaction or Uie indices of 
student achievement resulting from those bteractions. 

Given the dominance of textbooks observed by others, this is surprisbg; .their contents would seem 
useful in creating various bdices of student achievement, particularly knowledge acquisition. With the 
possible exception of Taba's work, which bcluded extensive curriculum development, the descriptive 
and empirical work on recitation and discussion has eschewed text except to note its central role. The 
observational schemes developed by Bellack and Davitz (1963) and Smith and Meux (1970), and used 
with some modification by others, do not take bto account the text material b use. A striking case b 
pomt is the fact that the most^common practice for dealbg with text, allowbg students to ^hear the 
textbook," has hot been evaluated experimentally, even though its close dependence on the text would 
render evaluation relatively straightforward. 

Despite the fact that there exists no bdeXsOf its effects, "hearing the textbook** contbues to provoke 
criticism from a variety of sources. Criticisms most often reflect the belief that the large numbers of 
questions directed at students by the teacher are not instructive b any meanbgful sense (Stevens, 1912; 
Durkin, 1978-79). Others criticize the kbd of questions, dtbg the higU ihddencc of "low-level factual 
detail" elicited by teachers' questions (Guszak, 1967; Dillon, 1984) as a probable cause of lower overall 
achievement. 

In summary, a survey of the classroom context quite clearly suggests that discussion of textbook content 
is the most prevalent //w/mc/io/ia/ process to promote learning information. To explore t^(^ important 
cofftitive processes, we turn now from the classroom context per se to the nature of the readbg 
comprehension task as it operates within that classroom context. Sbce the goal of such bstruction is 
to help students become more knowledgeable about specific domains of -bformation, we are 
particularly interested b reading comprehension as a tool for acquiring knowledge. 

Knowledge Acquisition and Reading Comprehension 

Knowledge Acquisition 

There is an bcreasbg body of work b knowledge acquisition growbg out of the more general work b 
schema theory. Briefly, schema theory (Rumelhart^ 1980; Anderson & Pearson, 1984) posits the 
existence of abstract structures that represent the organization of knowledge b memory. New 
knowledge can be acquired through a gradual process of assimilation or through a process of 
restructuring b which either new schemata are created to augment existbg schemata or old schemata 
are completely reorganized. 

Depending on the congruence of the new and existing knowledge, existbg knov^edge structures may or 
may not be altered as new information is encountered. What has been less clearly articulated to date 
are the mechanisms that prompt or enable these changes b knowledge structures (Vosniadou & 
Brewer, 1985, 1988). Several mechanisms have been proposed, includbg bduction of schemata, 
analogy and perceived anomaly or bcongruity. To date, the evidence appears to support analog}' as a 
powerful mechanism for restructuring (Gick & Holyoak, 1980, 1983; Vosniadou & Ortony, 1983); 
evidence supporting the other candidates is currently weaker. 

In addition to the underlying processes and mechanisms of knowledge acquisition, there is a third area 
of concern that may be generally subsumed under the rubric, approach to learning. Included here 
would be the control processes of a metacognitive nature: how the learner approaches a task and 
monitors his or her subsequent performance while carrying out that task (Brown, 1980). Through the 
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selective exercise of these control processes (particularly for intentional knowledge acquisiuon), the 
learner is able to focus on the salient properties of the to-be-leamed material in relation to what is 
already known and/or successfol approaches to learning. For example, in order for analogy to operate 
as an enabling mechanism, the learner must first appreciate the principle of analogical comparison and 
then be able to. identify and match parallelJerms or categories on two or more instances. As the work 
of Gick and Holyoak (1983) indicates, the presence of a poteriJially useful anaip^ docs not ensure that 
the learner will spontaneously notice ajid use it; for some learners the analogical properties of a second 
example with respect to the first must be explicitly signalled in some fashion. In a similar vein, Paris 
and Lindauer (1976) found that 7-year-6ids would draw inferences about the^instrument used to do h 
task (e.g. , a key to open a door) only after they were encouraged to "act out" the behavior in the orally 
presented sentence. Evcn^though they hadihe knowledge necessary to draw the inference, they did not 
spontaneously do so; m other words, they had the cognitive but riot the metacognitive knowledge 
necessary for .successfiil completion of the task. 

The work of Bransford and his colleagues (Bransford, Arbitman-Smith, Stein, & Vye, 1985; Bransford; 
Stein, Shelton^ & 0>^/ings, 1981) extends the notion of approach to learning. These authors have been 
able to dlstmguish more and less academically successful elementary school students on the basis of 
what they terin level of sophistication. More sophisticated students appear to engage in a spontaneous 
search for significance when faced with the task of remembering spedific factual information, rendering 
even arbitrary information more memorable. In contrast, their less successful peers apparently attempt 
to simply memorize the inforniatioa verbatim. 

The work on knowledge acquisition suggests that in designing instruction to facilitate knowledge 
acquisition several vconcems be addressed. First, structure is important, both in the way existing 
kno>^edge is structured and in the way new information relates to it. Second, there are various 
mechanisms such as analogy or induction that enable the learner to relate new to known iifcrmadon 
and acqure knowledge. Finally, there are more and less productive approaches that learners.may 
bring to the leammg task. The extent to which instruction stimulates and fosters these fundamental 
processes, mechanisms, and productive approaches is likely to Meetly influence students' knowledg^ 
acquisition. 

Comprehending Expositoiy Text 

Although to ;date there has been little research evaluating reading comprehension as a tool for 
knowledge acquisition, there are a number of separate strands of research that can be brought to bear 
on the issue. During the past decade, reading comprehension has been studied within the basic schema 
theoretic view described earlier. Several kinds of schemata have been associated with the 
comprehension process, most notably a schema for stories in narrative comprehension (Stein & Gleiin, 
1979), a schema for text structure (Meyer, 1975), and content specific schemata relating to the topic of 
a passage (Brooks & Dansereau, 1984). 

We know from a number of studies that sensitivity to text structure b associated Iwith higher levels of 
comprehension (Meyer, 1975, 1977; Meyer & Rice, 1982). Additionally, we know that students who 
initially exhibit low levels of sensitivity to text structure can be trained to attend to elements of 
structure (Meyer, Brandt, & Bluth, 1980; Taylor, 1982). Students can also be trained to recognize 
some common text structures in expository prose leading to enhancement of reading comprehension 
(Bartlett, 1978). 

Related to this work on text structure is the work on study techniques based on structural elements 
(Brooks & Dansereau, 1984;Taylor & Beach, 1984). From this work we can inifer that, in some cases, 
directing students to work with the overall content structure (headings and subheadings in the Taylor 
and Beach work; a structural or content schema in the . Brooks and Dansereau work) proves to be 
facilitative for students. Further, in cases where the text organization closely reflects the organization 
of the content schema, comprehension is even further enhanced. 
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Closely allied to the Brooks and Danscreau (1984) work is; the work of Annbrusler and Anderson 
(1985), which develops the notion of a jexl- content structure called a '^frame.'* A. frame is a content- 
dependent structure that corresponds to the cognitive entity^ schema, and that reflects the underlying 
conceptual structure ofithc discipline, the frame is a particularly promising notion for content areat 
instruction >^ere large blocks of content arc presented in a cumulative fashion. Recurring patterns or 
structures, specific to a particular content or knowled^^ domain, jnay help provide organization to a 
mass of information that may ckheni^ ^ unv^ to integrate or synthesize. 

Structure, then," is likely to be an. important factor m applying reading cpmprchensioiiikill to the 
knowledge acquisition task. Students' sensitivity to the structure of. prose influences comprehension 
and so perhaps knowledge acquisition. Wliile we have as yet ao eyidehce about awarenes$;6r sensitivity 
to structure beyond the passage level (i.e., the domain level; implicit in Arinbruster and Anderson's 
notion of frames), we do have the iSrooks and Dansereau , (1984) findings suggesting that texts that 
preserve and reflect the underlying conceptual structure of the content domain fadlitr.te 
comprehension. 

The importance of structure is' underscored by much of the work focusing on reader-based study skills 
that presume some knowledge of structure such as ndtetakiiig and outUnmg. Less com'entionaj are 
techniques which emphasize structure, but portray it inivisual ra&cr than verbal/form. these are the 
visual representation strategies such as networking (HoUey & Daasereau, 1984), concept mapping 
(Armbruster & Anderson, 1980), flow-chahing (Geva, 1984), instruct (Vaughan, 1984), and 
schematiang (Camstra & vian Bruggen, 1984). The results of training students tp.use thgise techniquei 
are moderately positive. Trained students.demonstrate superior niemory for and understanding otttxt 
material to which they apply these techniques when compared to the performance of untrained: 
students. 

In addition to the reader*based techniques, there are other, text-based practices that facilitate 
comprehension, and so perhaps knowledge acquisition. Of particular interest here, in light of some of 
the recent work on knowledge acquisition, is the practice of mduding supporting analogies in 
informational texts. Several, researchers have found that the mdusion of some form 6i* analogy 
fr.cilitated comprehension (Hayc5 & ticrney, 1982; Mayer, 1979; Rigney & Lutz, 1976; Royer & Cable. 
1976). 

In summary, the work on comprehending expository text supports; the .position that using reading 
comprehension as >\ knowledge acquisition tooj entails a general' awareness of the influence of 
structure-both t&e influence of text structure that characterizes pass^e organization and the influence 
of conceptual structures that (characterize the domain of knowledge under study. Knowing how to 
exploit structure to. extract and differentiate superordlnate and sul>ordinate units of text (notetaking, 
outlining) influences comprchendon. Similarly, geiieratmg a visual representation of content 
(networking, mapping, sc^ematizmg) serves to facilitate understandmg. Comparable graphic 
representations bdudcd in the text, if not. actually generated by :the reader, also serve to enhance 
cpmprchension by providing an overall framework for the interpretation of information as do analogies 
by helping readers relate new to known information. 

Developing an Alternative to Conventional Practice 

Given the insights available from our review of the mstructional context of content area instruction and 
our review of selected studies in knowledge acquisition and expository text comprehension,' we are m a 
position to discuss alternatives tor conventional discussion techwques. From these reviews it is dear 
that attention to stmcturtiboih the /ext structure and the underlying conceptual structure of Che domain, 
must be a primary concern of content area instruction. In contrast to the conventional practice of 
mtroducing text topics in serial order as a series of discrete segments, an alternative practice which: 
calls for the mtroduction of topics according to their relation to^the superordinate stnicture of the 
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content wa}> needed. Hence we developed an approach that sought to highlight important concepts and 
their interrelationships. To strengthen this basic plan, several additional features were included. 

One was to provide dear visual representations of the text content on the chalkboard and/or on 
overhead transparendes. These representations could Chen ftmaion as visual remforcements to help 
students understand key concepts and their interrelation, and as graphic analo^es to help students 
understand the relationship between previously covered material and new material Another feature 
was to encourage students to refer systematically to relevant portions of the text to support their 
contributions to dass discussion and to model for them how to use subheadings to help locate requisite 
information. 

More subtlcrfeatures concerned hdping students darify their own learning goals. We provided them 
with orienting questions and later asked them to generate their own prereading qisestions, based on 
what they had already learned. We alsb used the summary and review portions of the lesson to help 
students relate information they had just covered to the accumulated body of content so that they could 
integrate information both within and across daily text segments. 

In coring out. these plans, the teacher would then assume, at least initially, the primary butdjen of 
extradti^strucnire, representing it, prowding explidt analogies between old and new informatiob^xand 
gui^ systematic reference to relevant portions of the text. In effc^ the teacher would be 
responsible for guiding the group;in an externalization of the internal studying process that skilled^ 
riders use. Continuing the comparison, we can observe that the conventional practice most dosely 
resembles a studying tedinique of copious underlining, while the alternative resembles more dosely the 
techniques that exploit the content structure. For clarity, the two resulting forms of instruction arc 
labeled according to their respective manners of treating text content. That modeled on conventional 
instructional practice is labeled Discrete mcc text topics are treated serially and separately, whUe the 
alternative is labeled Integrative since text topics are treated in terms of their relationships to one 
another. 

An the different instructional treatments were developed, the investigations were designed to allow the 
exploration of po^ible differences in the general effects of these two basic approaches relative to a set 
of questions: 

1. Does instruction in the form of guided discussion of text content enhance students' 
knowledge acquisition? If so,, 

2. Does the type of instruction differentially influence students' knowledge acquisition? 

3. Does instruction facilitate students' independent reading comprehension? If so, 

4. Does the type of instruction differentially fadlitate students' independent reading 
comprehension? 

What follows is a report of a series of three studies, each designed to shed light on these questions. 
For each study, methods, results,.and discussion sections are provided. Finally there is ah overall 
discussion of the broad issues arising from our review and the questions that guided the development 
of the experimental design. 

StyDYONE 

Study 1 was undertaken as a preliminary study to explore some of the methodological problems in 
conducting research involving the operationalization of both the Discrete and Integrative forms of 
instruction and of developing dependent measures sensitive to knowledge acquisition and independent 
reading comprehension. 
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In Study 1, Disaete instruction (modeled on conventional practice) was contrasted to independent 
reading (no instruction) and two variants of Incegrative instruction (the alternative to conventional 
practice): one which added visual representations of text content to an integrative content discussion 
plan, and one ^ch directed students to refer systematically to the text during discussion^ 

Method 

Subjects 

Subjects for Study 1 were 48 fourth-grade studenU drawn from two fourth-grade classrooms of an 
elementary school which served as the Laboratory School for a midwert.ern university. Subjects were 
randomly assigned to one of four treatment groups. Each group was composed of six student^ from 
one class and six from the other* 

TVeatment Groups 

There were four treatments. One was an independent reading group receiving no instruction. ITie 
second was the Disaete instruction group; a third was Integrative with Visual Represeoiation, and a 
fourth Integrative with both Visual Representation and Text Reference. All three of the instructional 
treatments included a form of guided discussion. That model^^ on conventional practice: Disaete, 
involved oral reading and discussion of one paragraph at a time. The remaining two involved 
discussion of larger text r^gmenCs, usually of entire subsections* Since the in^nictional Sreatmenu o; 
the second, and more extfnsive study resemble those of Study 1 in many ioiportant respects, more 
detailed description of the instructional treatmento is reserved for Study 2. 

In Study 1 there were essentially two control groups, the Independent Reading group and the Disaete 
Instruction^ group. Two forms of atl alternative to conventional practice, the Integrative form of 
instruction, were developed. Each of these shared th6 same manner of ordering and discussing the text 
content. What differed was the number of additional features included in the instruction. One of the 
alternatives included only the Visual Representation feature (gniphically representing text content in 
chart fon^ on the chalkboard); the other included Text Reference (directic?.stu<2ents to cite specific 
portions of the text as they made contributions to the group discusrion) i/i iaMtfo/t to Visual 
Representation. 

Materials 

Materials for the study included a scries of five articles about ant societies used as instructional texf^ 
les^Bf plans for each of the three forms of instruction, a series of dependent, measures designed to 
assess knowledge acquisition, transfer to independent reading, and students' abilities to use texts as^ 
sources of information. 

The instructional te;as ranged in length from 400 to 600 words, and in difficulty from fifth- to seventh- 
grade level In an effort to preserve the textbook-like quality of the materials, illustrations of many of 
the major concepts were obtained from published sources and mduded with the text. Similarly, the 
texts conformed to cchventsonal textbook format through the use of titfes and subheadings* 

The dependent measures to assess kno^^edge acquisition included a 30-item multiple choice test about 
ant societies used as a pre- and posttcst measure, and a short answer test of passage-specific factual 
kno>^e(^e accompanying each of the five instru^ional articles that students.completed without access 
to the text, after rea<IIng or instruction. Measures to assess transfer to independent reading were a 
short answer test accompanying a new passage about another insert sodety, termites. The short 
answer test was parallel to the daily tests students had1>een completing during the instructional period. 
Additionally, there was an essay task accompan>ing the "termites" passage; this task required students 
to compare ant and termite societies. 
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Measures designed to assess text reference abilities included a speed and accuracy test of information 
location, and a test of the use of subheadings as indicators of text content. The information location 
test required that students locate answers to questioris by underlining and numbering them m the 
appropriate paragraphs. In aU there were four paragraphs with four questions each. The subheadings 
test required that students mdicate the section of a passage that they would refer to in order to answer 
a series of 20 questions about that passage. Students were not required to actually answer the 
questions. 

Procedures 

Students m each of the three instructional groups met with the experimental^ teacher (who was the 
investigator) at regularly scheduled times for each of 5 successive days. Each day students m all groups 
first read one of the articles silently, then participated m pne of the three forms of discussion^ and then 
completed the short answer test without access io the text. Students in the mdependent reading groups 
remained m their classrooms and were supervised by their classroom teachers. They first read the 
appropriate article silently. When they finished, they went to the teacher and exchanged the article for 
the appropriate short answer test which they completed independently (without access to the text) and 
turned m to the teacher. 

Analysis. For the analysis, a set of treatment cpntrastis was created* These mvolved comparisons 
between treatment groups correspondmg to the ba^c questions posed at the outset. The contrasts 
were: 

(1) Instruction/No Instruction (three instructed groups compared to Independent reading) 

(2) Discrete/Integrative (Discrete compared to the two forms of Integrative) 

(3) Text Refefence/No Text Reference (Discrete and Integrative with Text Reference 
compared to Integrative with Visual Representation). 

Working within a hierarchical regression framework, the. entire set of dependent measures was first 
evaluated for covariate by treatment interactions. Because there were no such mieractions, subsequent 
analyses proceeded usmg the reduced model evaluatmg first the effects of the covariate (prior 
knowledge) and next the treatment contrast effects. 

Findings. For both Knowledge Acquisition and Transfer to Independent Reading, there was a 
powerful effect for prior knowledge, accounting for from 28% to 54% of the explained variance. As 
Table 4 mdicates, there was also a significant effect for Contraist 1 (Instruction) on the multiple choice 
'posttwt^d on each-of the daily short-^answer measures*(all-means and'standard devi shown 
m Tables lr3). Con^tently, students participating in some form of guided discussion acquired more 
knowledge than students who read the. material on their own. Instructed students maintamed their 
advantage on the short answei test of their independent readmg comprehension of related content. 

[Insert Tables h 2,3,&4 about here.] 

There were a few significant <effects for Uie other treatment contrasts, but there was no apparent 
pattern to these effects for either Knowledge Acquisition or Transfer to Independent Reading. 

Discussion. The results of Study 1 mdicate that there is a strong and consistent effect for instruction 
on students* knowledge acquisition and on their independent reading comprehension. There is no 
evidence, however, to indicate that the type of instruction differentially influences either knowledge 
acquisition or mdependent reading comprehension. 
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Recognizing that with only 12 students per treatment group and an instructional cj'de of only 5 days, 
there might not have been sufficient time for instructional effects to emerge, a second, more extensive 
study was designed and carried out. 

STUDY TWO 

The purpose of Study 2 was to investigate more carefully the central questions addressed in Study 1. 
Specifically, the intent was to plan and execute instruction in such a way that transfer effects to 
mdependent readmg could be assessed more reliably. Accordingly, Study 2 had a longer instructional 
cycle and a correspondingly richer domain of instructional material: The knowledge that children 
could acquire was potentially more extensive. 

By exposing children to more information over a longer period of time, it might then be reasonable to 
expect more structure in the domain and correspondingly greater opportunity for children to acquire a 
schema for that domain. Over a longer period of time children might internalize both knowledge about 
the domain under study and knowledge about how to use texts as information sources. Both of these 
knowledge sources could mcrease the students' independent reading comprehension performance. 

The most powerful alteniative to conventional practice from Study 1, the Integradve vnth both ^%ual 
Representation and Text Reference, was selected for comparison to independent reading and 
conventional practice {Discrete Instruction). Even though the two forms of instnictioh differ in more 
than one respect, the first priority was to evaluate their overall effects, leaving the C3q)loration of the 
more specific reasons for any observed differences for later investigation. 

In this second study, although still a fairly tigjitly controlled study, a serious attempt was made to 
simulate more features of actual classroom instruction. This meant preparing materials that "looked 
like" school materials to the children; that is, they had to reflect important features of commercially 
prepared curricula. It also meant that classes should be held in an actual classroom with conventional 
furniture and equipment (chalkboards, overhead projectors^ eta). 

From^the bepnning this study was conceptualized as an intermediate step (in between a laboratory 
experiment and actual field testing) m the process of developing and evaluating in^ctional 
procedures for eventual use by classroom teachers. The belief was that it would have greater 
generalizability than a true laboratory study but less than one carried out with several different teachers 
implementing each type of treatment. If findings from this study ^ provided dear evideucc about 
differences m treatments m terms of students' outcomes, there would then be a firm basis for 
suggesting that teachers explore similar alternatives m their own practice. This is a particularly 
important consideration when an alteration may displace practices that are at least moderately 
effective. 



Many of the methods, materials, and procedures from Study 1 were used in Study 2. There were, 
however, some important differences m addition to those already mentioned. First, two additional 
categories of dependent measures. Approach to Learning and Knowledge Frameworks, were included 
The Approach to Learning measures represented an attempt to assess some of the metacognitive 
processes presumed to operate during knowledge acquisition and/or reading comprehension. 
Measures m the Knowledge Frameworks category were designed to d&scss some of the more abstract 
knowledge, such as a schema for insect societies or a schema for text organization, that students might 
acquire. 

Another difference was m the development of various elements of the general lesson format of Study 1. 
In Study 2 the revie>y and preparation for silent reading segments received more attention. Also, m an 
attempt to heighten the engagement of students in the Integrative treatment, and to expose them to the 
uses of charts that visually represented content, simplified versions of class charts were prepared for 
individual use as study guides during silent reading and discussion. Prior to implementing the 



Gallagher & Pearson 



Discussion, Reading Comprehension, A^KnowIedge Acquisition r 12 



e}q)erimenlal procedures for Study 2, the investigator worked in three different elementary schools with 
widely varying populations in an attempt to reHne the instructional procedures. 

Method 

Subjects 

Subjects for Study 2 were 72 fourth-grade students drawn from two intermediate level schools (grades 4 
throu^ 6) in a medium-sized suburban school district. Administrators of this school district describe it 
as a middle-class community distmguished primarily by its balanced racial mix. All students came from 
self-contained classrooms. 

Assignment of subjects. The ass^nment of students to one of three treatment groups proceeded in 
two phases. First, the district administration had requested that all treatment groups represent a mixed 
balance of students, comparable to their classrooms, so that no group would differ substantially from 
the others in terms of racial composition. 

To ensure that the treatment population resembled as nearly as pos»bIe^a typical fourthrgrade mix, 
Fall reading achievement scores for the entire fourth grade of the district were obtained. Students ^o 
were either extremely low or extremely high achievers were eliminated from the pool TTiis restricted 
the group of eligjMc students to those students \irith scores falling between 3.0 and 75 on a grade 
equivalent scale (Gatcs-MacGinitie Reading Achievement Test, Level D (1972)). This pool, after the 
initial screening, became the popidation (in each building) from which students were randomly selected 
and assigned to treatment groups. In one building there were three participating dassroouns, and in 
the other, two classrooms, in an :;ttempt to minimize effects due to classroom teacher differences, 
each treatment group was constructed from equal numbers of students from each of the pardapating 
classrooms. In one building this meant that there were four students from each classroom in each 
treatment group; in the other building, there were six children in each treatment group; the final result 
was a total of six groups of 12 students each. The appropriate number of students yiras randomly 
selected from each room, and then randomfy assigned to a tre«4unent group. After the groups had 
been constructed^ their racial compodtion was examined by the district administration for approval It 
was not necessary to make any changes m subject assignment to meet the radal balance requirements. 

The E3q>eriinental Teacher 

There was one teacher for all the treatment groups m the study. Again, the attempt was to eliminate as 
much variation as possible stemming from teacher differences. The teacher was the senior author of 
this paper. 

Instructional Treatment Groups 

There were three instructional treatment groups: Independent Readmg (no instruction), Disaete 
Instruction, and Integrative Instruction. 

Independent reading group. StudenU m this group ead all the material silently. They did not 
participate m any form of discussion or instruction. Nor did they talk about the material in an informal 
fashion with each other or with the teacher. In one sense this group served as a control for the other 
two groups-the absence of any form of instruction. In another, though, it served as an important 
informati(Mi source about what children can do vnih unfamiliar information when left to their own 
devices. From such a group we can bepn to get a sense of the scope of the instructional problem both 
teachers and students face. By mdudbg this group in the experiment, it was possible to evaluate 
whether either form of teacher assistance improved understanding. 
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Discrete instructioo grouj^. In this , treatment group./d'^igned to simulate conventional classroom 
practice (cf. "hearing the taabool"*:), after silcnt rea^g, students took turns reading the text aloud, 
paragraph by paragraph. As a student came to the end of a paragraph,, the teacher initiated a 
discussion of information in that paragraph without referring to information already discussed in 
previous paragraphs or foreshadowing iiKormation from later parr^aphs. Since the focus of each 
discus^on segment a single paragraph, the questions that guided the discussion centered on 
specific factual information rather than relations between facts that might appear in separate 
paragraphs. This restriction of focU5 did not prevent the teacher from asking inferential or explanatory 
questions; it simply minimized the opportunity for posing such questions when they might require 
doss-paragraph integration of content: 

In the (Course of^a class period, students read and discussed one section of the instructional booklet 
entitled Insect Societies pr^pwd for the study. The general orientation suggested to students by the 
teacher was one of "getting the facts straight." 

Integrative instnictioD group. In this treatment group students partidpated in a discussion that was 
designed to jprovide them a more comprehensive view of the domain under study. Accordingly, 
relations i^^thin and aaoss text segments formed the basis for planning the discussion. Two additional 
features characterized this form of instruction: (a) the text information was graphically represented for 
and by the students in the form of a chart drawn on the chalkboard or on overhead transparendes 
during the course of the class (^ual'Representation); and (b) students were encouraged to refer to 
the text repeatedly during class as the teacher asked them to find and read pertinent sections of the texi 
to support or clarify answers to questions raised during discussion (Text Reference). In the course jf 
the instructicMi^ the teacher modeled.for students strategies for surveying the text in order to find 
pertinent information, making frequent reference to section titles and subheadings within sections. In 
contrast to the general orientaliop to the material suggested by the teacher for the Disaete instruction 
group, the orientation suggested for the Integrative group was one of "seeing how the facts fit together." 

Instructional Materials 

Texts. Student :.exts were specially consUucted for Study 2. A booklet entitled Insect Societies 
consisting of 14 distmct sections was prepared The domam of knovdedge for students to acquke, then, 
was insect sodeties. This topic was chosen for several reasons. First, it is a topic that is generally 
outside the fourth-grade science curriculuni, rendering the material nnf^mili^r to the maximum 
number of students. Second, though the topic is not usually covered in fourth-grade sdence, it certainly 
falls within the scope of content that fourth-grade, students can understand. Finally, the topic is one 
that students of this age find interesting. 

In the construction of the materials, many of the same criteria adopted for Study l.were used. First, 
the format was to resemble as dosely as possible that of a typical content area textbook. This meant 
that there would be a table of contents, section titles and subheadings. Also, there were pictures with 
oiptions, illustrating some of the more salient topics mentioned in the texts. 

The booklet contamed two mtroductory sections about sodai organization in the ammal world and then 
three separate chapters, one for each of three insect sodeties-ant sodeties, bee sodeties and termite 
sodeties. In preparing the content for the different chapters, the first decision concerned the structure 
of information to indude about any insect sodety. A general structure or framework was determmed, 
and then information about each different sodety was gathered and structured along parallel lines. 
The general framework for each sodety was. 
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Insect Society 



A. Getting Started 



1. Mating 



2. Caring for Young 



B. Keeping Going 



1. Food Gathering 



Z Nest Building 



This mfonnation was then displayed in chart form: 




[nsea Sodetyj. 



[Getting Started I ^ tKceping Going | 





I Fo<^ Gathering] 




appropriate section titles and subheadings i^never posrible. So, for example, the section beginning 
the chapter on ant sodeties contained a subsection tfie heading How an Ant Society Begfns; the 
section beginning the chapter on termite societies contained a similar subheading, Starting d TemUte 
Society. In deigning these materials, particular efforts were made to ensure that the subheadings did, 
in fact, s^nal the content contained in the subsection so that die booklet would represent a good 
example of the factor we know or suspect lead to weU*written, or considerate, student textbooks 
(Armbruster & Anderson, 1984). ^ 

Sections varied in length from 400 to 600 words. Difficulty, as measured by two readability formulas, 
also varied Readabilityjeyels for each daily section were calculated using the Dale-Chall and the Fry 
scales. As is evident from Table 5, there is a range of difficulty levels represented, according to these 
formulas. Determining actual difficulty of content materials is problematic, however, and these 
formulas were originally developed for use primarily with narrative texts, rather than expository. Since 
one of the principal factors is word length and/or unfamiliarity, content materials rich with specialized 
vocabulary are apt to be rated as quite difficult. Substituting other, perhaps more familiar words for 
the longer, less familiar items is lively to compromise the precision of these texts, and hence the 
accuraqr of the information being related. The decision was made to allow the difficulty to vary, 
reasoning that as information was being presented in a cumulative frishion, with many items repeated, 
and many concepts recurring, the true difficulty would be nearly impossible to gauge. 



In order to simulate real texts, pictures were included to illustrate as many of the main concepts as 
possible. These were taken from a variety of published sources, and labeled using the language of the 
texts. In selecting pictures, criteria of clarity and realism were used. 

Lesson plans. For each of the two discussion treatment groups (Disaete and Integrative treatments), 
lesson plans were drawn up usbg a pre-determined format. To ensure that the same basic information 
was introduced during discussions for each treatment group, a content outline for each section of the 



[Insert Table 5 about here] 
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booklet (students read and/or discussed one section each day) was prepared These content outlines 
then were used to develop matrices which visually displayed the content. As plans were drawn up for 
each instructional group, they were checked against these Lesson Matrices toiensure content coverage. 

For the Discrete Instruction group, plans were formulated in the following fashion. For each 
paragraph of the text section, questions about the information in that paragraph were written to guide 
the subsequent discussion. 

The lesson plans for the Integrative form of discussion were more complicated. First, using the 
appropriate Lesson Matrix, the basic structure of the section was outlined, revealing the major topi« 
and their relations to one another. Next, the text was divided into units for discussion; usually a 
discussion unit corresponded to a subsection within one day's section of the booklet FmaUy, topics 
within discussion units were identified, and discussion questions written for the topics. These questions 
were checked against the appropriate Lesson Matri)^ as were the questions for the Discrete group. 

When the daily scdion had been outlined, there remained several other steps for the Integrative lesson 
plans. First, a chart representing the overall structure of the section \wth the content appropriately 
displayed was prepared This chart would be duplicated on the chalkboard and filled in by the students 
during class discussion. Since so many sections.of the text lent themselves to a two-way classification 
organization, the chart usually took the form of a matrix with column and row headings. Next, the text 
section was related to the entu . chapter, and where appropriate, to the entire booklet. So, for ^ 
example, the third section of Ctapter One, Ant Societies--"Next Construction in Ant Societies: Above 
Ground Nest Building," an overhead transparency was prepared showng where, in the general 
fi^amework, this section fit: 

Ant Societies 

Getting Started Keeping Going 

Mating Food Gathering 

Caring for the Young Nest Building 

Above Ground 



Below Ground 

During dass sessions for this treatment grpup-the teacher's objective was to have students understand 
the relationships evident wthin each text section and across text sections as the instructional qrcle 
progressed. In contrast to the Discrete form of discussion in vAnch the emphasis was on "getting the 
facts straight," the integrative form of discussion emphasized "gettmg the big picture." The "big picture" 
expanded as the unit progressed, emphasizing the cumulative nature of the information and the 
structural characteristics of the material. So, for example, when the topic of Starting Bee Societies was 
covered, the students were encouraged to compare the information to the parallel topic for ant 
societies ^ch they had read about a week earlier. 

TVanspareiides. Overhead transparencies were prepared for the IntegraUvc Treatment group. ThestS 
were of two types. One type was simply a copy of the chart that the teacher and students completed 
together during a class session. This then was used in two different ways: (a) as the material for a 
brief review at the beginning of the next class session, and (b) as a means of helping students determine 
the sorts of information they would likely encounter in another text section on the same topic. For 
example, when the students were about to read the section on Nest Building in Bee Societies, they 
looked at the chart(s).prepared for Nest Building in Ant Societies, This served as a means of focusing 
the students' attention on the topics they would encounter, as well as the sort of information they could 
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find out about those topics (i.e.» which questions they should be asking themselves). As such, these 
transparencies functioned as graphic analogies. 

Stu4y guides. For the students participating in the Integrative form of discussion, Study Guides were 
prepared These Study Guides duplicated the format of the chart** that were displayed on the board or 
on overhead transparencies on a daily basis. Beginmng with the second chapter of the booklet, Bee 
Societies, students filled in their study guides as the class progressed through each day's material. For 
the early study guides, all of the row and column headings were provided for students; for the later 
guides, these spaces were left blank for students to fill in themselves. 

Procedures 

The classroom. Both classrooms, one in each school, were standard classrooms,, equipped with tables, 
chairs and chalkboards. 

Overall procedures. The entire set of procedures was first carried out in one building, and then 
repeated 4 weeks later in the second building. 

To reduce potential bias stemmmg from testing treatment groups separately, students were pretested 
by classroom, rather than by treatment group, over a period of 3 days. At the conclusion of the 
pretesting period, all participating students attended, again by classroom group, two 50-minute 
orientation sessions. During these orientation sessions students were told the purposes of the study, 
introduced to the camera operators, and were allowed to watch themselves on videotape. Additionally, 
the orientation period served to introduce students to the domain that they would be studying, insect 
societies. Two discussions were held, one on each of the orientation days, about social organization in 
the animal world. ^ 

After the orientation period, students reported to the classroom by treatment group at regularly 
scheduled times each morning. In the first building the Disaete Instruction group met first, the 
Independent group next, and the Integrative group last. In the second building, the order of meeting 
for the two instructional groups was reversed. In all other respects, the procedures followed in the two 
buildings were precisely the same. All lessons in both buildings were videotaped. 

At the conclusion of the instructional cycle, students were posttested over a 5-day period. Again, 
students reported for testing by classroom rather than by treatment group to minimize bias in testing. 

Class meetings. Daily class sessions lasted 45-50 minutes for the two instruction groups and 20-25 
mbutes for the Independent g^oup. Students from all the groups returned to their classrooms as soon 
as they had completed their daily worksheets. For each of the 12 days of instruction, the lesson plans 
preserved parallel format for the respective groups. 

Dailv Lesson Structure and Time AHocations: 

Independent Reading Grou p 

I. Silent Reading 10 minutes 

II. Daily Worksheet 10-15 minutes 

Discrete Instruction Group 

I. Brief Review 3 minutes 



II. Silent Reading 3-5 minutes 
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III. Oral Reading and Discussion 25-35 mbutes 

IV. Brief Summary 3 minutes 

V. Daily Worksheet 10 minutes 

Intcprative Instruction Group 

I. Brief Review (wth transparencies) 3 mbutes 

II. Pre-reading Orientation and Purpose Setting 2 minutes 

III. Silent Reading 3-5 minutes 

IV. Discussion and BoardAVork 25-35 mbutes 

V. Brief Summary ( with transparencies) 3 mbutes 

VI. Daily Worksheet 10 minutes 

The approach to the design of instruction adopted for this study was to exploit each a»inponent of the 
lesson structure b a manner consistent with the overall goal of the type of lesson. So, for example, 
during the piirpose-settbg portion of each Integrative lesson, fie teacher btentionaUy attempted to 
promote children's tendency to relate known to new information by using previously covered material 
to help define a purpose for rcadbg and discussbg new material. iSbce relating new to known 
information was not a basic goal of the Disaete instruction, the teacher defined purpose b a very 
general way for students, restricting their attention to one specific section of the booklet, the topic of 
that day's section. 

Although each instructional group of students engaged b revie\^ing and summarizbg, the forms of 
review and summary differed for the two groups. In essence, these differences of form represented 
realizations of the fundamentally different goals of the two kmds of instruction* To illustrate briefly, 
for the Integrative instruction, the scope of the content was. presumed to widen as students were 
exposed to more material. Therefore, the teacher reviewed the previous day's material in the contra of 
all previously covered material^ Similarly, when summarizing, the teacher encouraged students to 
consider that day's information b light of previously discussed content (e.g.. What sorts of food do you 
suppose the underground nest builders gather?); During the review and summary portions of the 
lessons for the Discrete group, on the other hand, the teacher focused instead on that day's material, 
mamtainbg a consistently more narrow fociis throughout the different parts of the lesson. 

As a rule the class meetbgs for the Discrete Discussion group tended to be shorter (by 2-4 mbutes) 
than those for the Integrative Discission group. This difference reflected mainly the time for review 
and the prereadbg orientation readbg b the Integrative Instruction group. 

For the Independent Readbg group the teacher gave each student a copy of the Insect Societies 
booklet when all the students were assembled. As students finished readbg the appropriate section of 
the booklet, they came to the teacher to exchange the booklet for the appropriate Daily Worksheet. 
Students then completed the worksheet wthout access to the booklet. When they had finished with the 
worksheet, students turned it b to the teacher and returned to their classrooms. During silent readbg, 
students were told that they could ask for help wth words that were difficult to pronounce. It was 
explained that no help could be given with the worksheets. Students were allowed as much time as they 
wished to complelr their silent readbg. Because of the lack of bteraction b this group, their bterest 
and morale was carefully monitored throughout the study by the experimental teacher, the classroom 
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teachers, and the principals. Throughout the study these students faithfully came to class and 
completed their worksheets; no overt complaining was observed. 

Students from the two discussion groups received the same worksheets after the summarizing portion 
of the lesson. They completed these worksheets independently, without access to the text. 

No formal feedback about their performance on the Daily Worksheets was given to any group of 
students. To guard against potential bias, the teacher did not score the worksheets until after the study 
was completed; therefore, during the jactual instruction, the only information regardmg student 
performance available to the teacher was their class performance during discussion. 

To determine whether or not students were completbg the worksheets correctly, the teacher did read 
all of the first set of worksheets. Many students were supplying answers that were loo abbreviated to 
answer the questions adequately. At the bepnning of the second class meeting, the teacher showed 
students sample answers to one qf/the previous da/s questions. One answer was extremely brief and 
the other more detailed. The teacaer asked the students to judge which answer was the better, showing 
more about M^at the student knew. A quick perusa} of the second da/s worksheets indicated thr.t 
students were, b general, suH)lymg more completeimswers to the questions. No further discussion of 
this sort took place for the remabder of the instructional period. The same example was used b the 
second buildbg on Day 2 of their instruction. 

Design and Analysis 

Overview of Design 

The design of this study is a 3 x 2 Factorial, with three levels of Instruction and two levels of School 
This design allowed us.to address two primary questions concermng the consequences of instruction: 

1. Does instruction, in the form of guided discussion, enhance students* knowledge 
acquisition and/or their mdependent readbg comprehension? 

2. Does the type of instruction differentially influence student performance with respect to 
either knowledge acquisition and/or bdependent readbg comprehension? 

In . jnpler terms, followbg such instruction, do students know more about what they have read? And, 
are there any differences b their bdependent reading of content area texts they have never seen 
before? 

To address these questions, a series of hierarchical regression analyses were carried out for each of 
several categories of dependent measures. Using two covariates (readbg ability and content 
vocabulary kno>^dedgc or the appropriate pretest score for measures not directly related to specific 
knowledge), the same general framework was employed for all of the/regression analyses. These 
analyses were carried out b tv/o phases: (a) evaluation of covariate by treatment bteractions and (b) 
evaluation of treatment effects. 

The treaUnent effects were evaluated through a set of orthogonal contrasts correspondbg to the two 
primary questions. Accordingly, Contrast 1 compared the two types of instruction with mdependent 
readbg. Contrast 2 compared Discrete Instruction with Integrative Instruction. Below, the general 
hierarchical framework for the full model equation is described in the order b which effects were 
removed from the model. 
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STEP 

(1) Covariates: 

(a) Reading Ability (RA) 

(b) Content Vocabulary (V) (Or appropriate pretest) 

(2) School (S) 

(3) Treatment Contrasts 

(a) Contrast 1 (CI) 

(b) Contrast 2 (C2) 

(4) School X Treatment Contrast Interactions 

(a) School X Contrast 1 (S X CI) 

(b) School X Contrast 2 (SXC2) 

(5) Reading Ability by Treatment Interactions 

(a) RAXS 

(b) RAX CI 

(c) RAXC2 

(d) RAXSXCl 

(e) RAXSXC2 

(6) Vocabulary by Treatment Interactions 

(a) VXS 

(b) VXCl 

(c) VXC2 

* (d) VXSXCl 
(e) VXSXC2 

Evaluation of covariate by treatment interactions proceeded in two steps, using the general formula 
(Kerlmger & Pedhazur, 1973): 
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(r¥-r2r)/(J.Kj) 

F ratio = ^ 

(l.R2p)/(N-J-l) 

(Where F ^ Full and R ^ Reduced, J ^ total predictors, and Kj ^ predictors of Step i). 

To begin'the evaluation, the full model included all the terms lip through Step 6. Using the formula 
given above, interaaion of the Vocabulary covariate and treatment effects was tested (five terms of 
Step 6). If this step (combined across.ail five interaction terms) was riot significant, the same set of 
procedures was^usedio evaluate Step 5 of the Full Model. equation, the set of Reading Ability by^ 
treatment interaaion terms. 

At the outset, the plan was to evaluate the entire set of dependent measures for possible covariate by 
treatment interactions in the same fashion. If there were covariate by treatment interactions^ the 
interactions would be separately analyzed using the Jphnson-Neyman technique (KerUnger & 
Pedhazur, 1973). If there were no covariate by :treatment interactions, the twice-reduced model 
(eliminating Steps 5 and^6) would be used to analyze performance on the dependent measures. 

Working with.the reduced model, the data would first Ibc; analyzed for interactions of the riiain effects 
(School X Treatment Contrasts). Simple effeas test (treatment contrast within building) would be 
carried out for all such interaaions. If there were nonsuch interaaions, the main effects would be 
interpreted. 

Originally, there was a third covariate for these analyses. Pretest on Specific Faaual Knowledge about 
Insect Societies. Due to very low reliability (alpha = .Ct3) caused by the children's limited pridr 
knowledge about insea societies, this measure accounted for very little variance and was dropped from 
the analysis. 

As the analyses were completed, they were examined by category of dependent measure to increase 
clarity in the interpretation of findings. Each category and the raeasufis developed for it is described 
more' fully in the following sections. In all, there were five categories of dependent measures: (a) 
knowledge Acquired, (b) Transfer to Independent Reading, (c) Text Reference, (d) Approach to 
Learning, and (e) Knowledge Frameworks. 

Covariate Measures 

Test of reading achievement. Student scores for the Gates-Macgihitie Reading Achievement Test, 
Level D (1972) (October norming) were released for use in this study. These scores were used initially 
to screen students for the sample of eligible students, and later as a covariate in the main regression 
analyses. 

Content vocabulary test. This was an Anderson-Freebody Vocabulary test (Anderson & Freebody, 
1983). It consisted of 100 words. For each word, students were to indicate whether or not they knew 
what it meant by curding either yes or no beside each word. Included in the list of 100 items were the 
usual proportions of content words, pseudowords, and standardized vocabuIar>; test words (taken from 
the Stanford Reading Achievement Test, Vocabulary. Subtest (Form B, 1976)). This measure was 
designed to measure students' general (as distinct from specific), knowledge about the domain of insect 
societies, prior to reading and/or discussing the Insect Societies booklet. It was to serve as an 
additional covariate in the analyses of covariance and was adminiseered as a pretest only. 
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Knowledge Acquisition Measures 

These arc among the principal measures of the study, since the first of the primary questions concerns 
students' acquisition of: 

Multiple choice tesU of factual knowledgf. There was one multiple choice pretest of 30 items, with 
five answer choices for each, one of the choices an T don't know* option. The items were generated in 
the following manner. First, using the Lesson Matrices of text section content, two questions for each 
of the 12 instruaional sections of Uie Insect Societies booklet were written. These questions 
corresponded to information that was prominent in the content outiine and expU • stated in tilie text. 
AdditionaUjr, six more general questions were written relating to the gj^nctrntcd insect society 
framework (e.g., food gathering, nest building) or social organization in the animal world. This pretest 
was designed to provide an indication of the specific factual knovrfcdge about insect societies that 
students possessed prior to the instruction. By intention it was later to serve as a covariate in the 
analyses of covariance; however, as already mentioned, it was dropped for lack of reliability. 

For tile multiple choice posttest, the 30 items used in tiie pretest were combined witii an additional 30 
items abput the text content. These items were generated in the same fashion, so that for the posttest 
tiierc we:re four items about each of the 12 sections Of the booklet. The multiple choice posttest was 
administjired in two parts on separate days, with the first 30 items in Part I and the second 30 items in 
Part 11. 

The daily measures. There were 12 Dafly measures, one for each of tiie four sections of the Uiref 
chapters of tiie Insect Societies hooklci. The worksheets, as tiiey were described to tiie students, all 
followed the same format, requiring short written answers to 10 to 12 questions about each da/s 
content. Comparable measures from Study 1 allowed the evaluation of the quantity of students' 
knowledge but not the quality or kind of knowledge* Accordingly, altiiough tiie exact number of 
questions varied from worksheet to worksheet, each worksheet included tiu-ee types of questions: 
factual, explanation^ and application. The factual questions were about information expUdtiy stated in 
the text (e.g., What sort of food do the juice-drinker ants eat?). The oqpUnation questions required 
that students describe or explain in their own words some aspect of tiic content (e.g., Explain how bees 
communicate information about food sources). The application questions required tiiat students use 
some aspect of the information covered in a new context (e.g., Some termites never/leave the mound; 
what makes this possible?). 

IVansfer to Independent Reading Measures 

These measures were designed to address the second aspect of the primary questions under study: 
Docs instruction influence students' mdependent reading comprehension? Three pa^es were 
prepared that varied in degree of similarity to the instructional material, using the categories olf topic 
and structure to differentiate degrees of relatedness. The three topics were-in decreasing similarity- 
Paper Wasps (closely related), another insect society, Micmac Indians (related, a human society), and 
Landforms (completely unrelated). 

During the posttesting period, students first read one of the passages. After finishing, they exchanged 
the passage for a short answer worksheet similar to tiie ones constructed for the Daily measures. 
Next, for the Paper Wasp and Micmac Indian passages, they completed a v^itten task that required 
them to note similarities and differences between the information in eaca of the passages and the 
material read during the instructional phase. For the third passage (Landforms), which was unrelated, 
the written task was a free recall task« 

The logic of these transfer tasks was as follows. If instruction transferred to Paper Wasps but not the 
other two, then one might argue that an insect society schema was responsible for transfer. If transfer 
extended to Micmac Indians but not Landforms, then generalization from insect societies to societies in 
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general might also be responsible. However, if transfer extended all the way to Landforms, then the 
inference is permitted that students, in addition to what they learned about insect societies and sodal 
organization, must have acquired a schema for how texts are organized. 

Text Rererence Measures 

There are two measures in this category; each relates to a cBfferent aspect of the text reference feature 
of the Integrative Instruction treatment. Both measures were administered as a pre- and a postte^. 

Locating spcdflc Inrormatlon. This measure consisted of a series of four paragraphs adapted from a 
fourth-grade social studies textbook* After each paragraph, a list of four questions appeared. The 
students' task was to underline the section of the paragraph that provided the information necr^ssary to 
answer each question and to put the number of the question beside the underlined part. Tl-lis was a 
timed measure; the students all began at the same time, and each recorded the time of completion by 
referring to a distal display clock (minutes and seconds) placed in the front of the room. 

Using sabbcadlttfs as a guide to content this measure was designed to assess students' ability to use 
subheadings to help them locate appropriate content. The task invoked referring to a 7-section 
passage entitled **Rice Growing on Java.* Each section had an underlined heading and a number 
placed in the right-hand marpn. Students used an answer sheet divided into two parts. First, there was 
a list of 20 questions. The students were to read each question and decide whether or not the article 
would have the answer to the question. Students were cxplidtjy told that they Si not have to read the 
passage to complete the answer sheet. Aftei mdicating (by drcUng 'yes' or 'no' for each question) 
>^ether or not they thought the passage would contain the necei^iary information, students went on to 
the second part which entailed identil^ng the correci section for each of the questions with a 'yes' 
answer an the first part. This, too, was a timed test; students were allowed 4 minutes to complete this 
test. 

Approach to Learning Measures 

The three measures in this category were designed to mas various aspects of reading comprehension 
skill presumed to operate during content area reading. Each was administered as a pre- and a posttcst. 
If, in the analysis of the transfer measures, there appeared to be an effect due to instruction, 
particularly on the third, unrelated passage, mformation about the various skills these measures were 
designed to assess might add explanatory precision. 

Determining relevance of informalloo (the Queth)* For this measure a passage describing a 
hypothetical alien was prepared. The passage contained various information about the physical 
characteristics of this alien (called the Queth). 

After students had fmished reading the passage, they were given a sheet vrith a problem stated at the 
top. Below ^e problem was a list of questions. The problem asked students to imag^ie that they were 
sdentists working in a laboratpry. Further, they were to imagjuie the following scenario: Someone 
brings an unidentified aeature to the laboratory. They think the creature is a Queth, but are not sure. 
They ask the scientist to examine the creature and decide whether or not it is a Queth or some other 
kmd of alien. 

After reading the scenario (read aloud to the students, after they had read silently), the students were 
to read all of the questions listed in the section bcJow and put a check hy onfy those questions that they 
would need to ask in order to decide whether or not the creature was, in fact, a Queth. The students 
could choose as many questions as they liked, from 1 to 17 (the total number of questions). The 
questions varied from aitical to irrelevant, with important and relevant bewg intermediate categories. 
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Relntlag new {nrormatlon to old (Ebars)* For this measure a passage about three members of a 
hypothetical plant family (Elzars) was prepared, including parallel information about each member of 
the plant family (e.g^ soil and light requirements, leaf color, and shape). StudenU were to read the 
pasMge tnd then to go on to complete the second part of the task* On a separate, ^eet, a fourth 
member of the Elzar family was described* the students were directed to read about the fourth 
member and then to answer lO^questions listed below the descripUon. These questions took the form 
of analogies in which the fourth mer.ber was compared to one of the origbal members along one of 
the critical dimensions of classification. Students y^ere told that they could look back at any section of 
the passage that they wished to ^^lile completing the analogies. 

Deflntng purpose for reading (Rei^ons for Rcadiof)* This measure consisted of a scries of 10 
paragraphs adapted from fourth-grade social studies and science textbooks. Following each paragraph 
was a series of three 'Reasons for^Reading.! The studenU' task was to assume that they would be 
iUtoring younger children, and that they were, trjing to ffvt the younger students a purpose for reading 
(related to vAm they could learn if they read the material). Accordingly, the students were to first read 
a paragraph and then choose which of the three 'Reasons for Reading* they would gyt to a younger 
student The Keasons for Reading* were either too generid; too narrow, or appropriate. Before 
beginning the task, studbnts were assuredf that there was no *ri^t* answer for these items. 

Knowledge Framewolic Measures 

In this category, there were three measures, ecch administered as posttests only. One concerns the 
schema for insect societies, another a schema for textbook organization, and the third the ability to 
extract superordinate unit5 of information from prose and lo^cally arran'^e them. 

Insect society schema. For tiiis measure, students were asked to.imagine that they were going to teach 
andtber group of students about insect sodeties. In order to do this, they would have to decide which 
topics they would n^chtbn and what sorts of information they would include about each topic. On a 
prepared answer sheet they listed the topics. Next to each topic, they could list Uie various pieces of 
information they v/ould mention in spaces proviofed. 

Text content otyuiIzatloQ schema. For this measure, administered immediately before reading the 
Paper Wasp Society passage, students were asked to predict what sorU of informaUon they would be 
likely to encounter in th^ Paper Wasp Society passage and how they thought it would be organized. On 
a separate sheet of paper, students identified the topics and described the organization that th^y 
anticipated finding. 

Chart completion task. This measure was included^ to attempt to ascertain the degree to which 
students could (a) identify parallel elements within a passage and (b) their ability to arrange these 
elamenu in a logical form (a matrix, with row and column headings). During the posttesting period, 
after the students had finished with the transfer to independent reading measures, the investigator 
illustrated the concepts Quirallelism of elements and a matrix array) using information from the 
"Landforms" passage. As practice, a matrix was completed on the board by the entire group. Then, 
students independently complet'^d a similar chart (supplying title, row and column headings) for the 
**EIzars* passage, oi^e which leattt itself particularly weU to represenUtion in matrix form. The task was 
completed after students had finished the analogies task for the "Elzars" passage and the two measures 
designed for the "Landfprms" passage* 

Prior to scoring any and all of the measures, all student names were obliterated, and each piece of 
student data identified by a number from 01 to 72. 
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Scoring for the Covariates 

Test of reading achievement. Fall scores for the Gates-Macginitie Reading Achievement test (Level D, 
1972) were released by the district. Raw scores for Total Comprehension were used m the analyses. 

Content vocabulary measure. This measure was scored according to the Anderson-Freebody formula: 

P(k)= (p(h)-p(fa))/N 



(1-P(h))/N 

(where h-hits, fa -false alarms, ic= known, and n= number of content words) 

As application of this formula yields scores in proportions, they were later transformed usmg the arcsm 
transformation before being used for analysis. 

Scoring for Knowledge Acquisition Measures 

Multiple choice measures. These measures were scored right, wrong, or T don't know.* Various totals 
and' subtotals were then created coriresponding to either topics (food gathering across societies) or 
units (mdiviflual inspect societies). Reliability of these measures was determmcd by computing 
' Cronbach's Alpha, correcting for the 'I don*t know" option. Alpha levels for the 30-item pretest and for 
the 60-item posttest were .03 and .87, respectively. 

Daily measures.. Prior to scoring these measures, a scoring key was developed for each. Keys 
mdicated acceptable student responses, and the point values to be assigned to each response. Next, 
copies were made^-of a sample of these measures, representing equal numbers from the various 
treatment groups. Student papers making up the sample for any given daily measure were randomly 
drawnirom the entire sample of 24 for each group. TTiis sample, representing approximately 17% of 
the total, was used to determme interjudge reliability. 

One person scored the entire sample of daily measures once. Two other people each scored a subset 
of the reliability sample; one scored measures for Day 1 through Day 6, and the other scored measures 
for Day 7 through Day 12. All scorers used the prepared Scoring Keys. To determme the reliability of 
the scoring procedures, correlations between the actual pomt assignments for each question for each of 
the daily measures was calculated. These correlations are shown below: 

Dayl r=.94 Day 4 r=.94 Day 7 r=.93 Day 10 r=.95 
Day 2 r=.95 Day 5 r=.99 Day 8 r=.93 Day 11 r=.98 
Day 3 r=.94 Day 6 r=.97 Day 9 r=.96 Day 12 r=.98 

Overall, the correlations are very high, indicating that the Scoring Keys elicited highly similar 
classification across judges. 

Once the scoring procedures har* been judged reliable, a number of different scores were created from 
the corpus of 12 daily measures, first, for each day four scores were created: factual explanation, 
application, and total. Logically, the next set of scores would be those collapsed across several days to 
yield end-of-chapter scores, as well as total booklet scores. 

To create this next set of scores, a series of proportion scores was created for each of the four 
categories, total, factual, explanation, and application. Since the measures had varying numbers of 
possible points, and since not all students were present for each of the 12 days, the proportions were 
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necessary in order to combbe scores across days, and to use the maximum amount of data av^able m 
creating chapter and booklet scores. For instance, without proportion scores, a student who was absent 
for one of the four days of Chapter One could not be compared to one present all 4 days on a simple 
summing across Days 1 through 4. 

Scoring for Transfer to Independent Reading Measures 

For CdCh of the three short' answer measures in this category, the same procedures for determining 
reliability as were used for the Daily Measures were adopted. Correlations between two scorers for 
question by question pomt assignment for approximately 17% of the sample were .94, .96, and .97 for 
Taper Wasp Societies,- The Micmac Indian Society," and "Landforms," respectively. 

Once the mterscorer reliability had been established as adequate, four scores were created for each 
passage: factual, explanation, application, and total 

For the various essay measures (noting similarities and differences, or recall), a separate set of Scoring 
Keys was developed. Again, correlations between the two scorers for 17% of the sample were 
calculated These correlations were -86 for Taper Wasp Societies," .87 for the "M.cmac Indian 
Society," and .86 for "Landforms." For the two similarity and difference essay measures two scores 
were combmed (number of similarities cited and number of differences cited) to creatp a score for 
total number of comparisons. For the recall measure ("Landforms"), a content hierarchy, aj^igning 
varying pomt values to text units wais used to create a total point score. TTiis system weighted the 
importance of the information included m the recalls* For example, a student v/ho recalled several 
units at the highest level of the hierarchy received more points than a student who recalled primarily 
lower Jbvel units, even though the second students may have recalled more units than the first* 

Scoring of Text Reference and Approach to Learning Measures 

insect society schema. A key was developed which identified seven major topics dravwi from the lesson 
matrices for the instructional material, and a range of three to nine pieces of information associated 
with each topic. To determine reliability, a subset of the sample was first scored independently by two 
scorers usmg the key* A correlation of 0.93 was obtained* ThSwas judged adequate and scoriifg of the 
rt aainder of the sample proceeded. Two scores were created for each student, the total number of 
topics identified and the total number of relevant items specified. 

Text content and organization schema. For this measure two keys were developed, one to score the 
major topics and a second to identify subheadings to indicate anticipated text organization. The key to 
the first part isolated three levels of topic importance based on subheadings from the instructional 
materials. The key also distinguished between topics (signalled in the text's subtitles) v/hich were 
common to all three societies (e.g., Getting Started) or specific to one society (e.g.. Temperature 
Control m a Termite Mound). The key to the second part of this measure listed the actual subheadings 
m hierarchical fashion and specified whether each was common to all or specific to one sodety (e.g., 
under Keeping Gomg at the highest level cf the hierarchy vyere listed Food Gathering and Nest 
Construction at the second level; under Food Gathering such subheadings as Gathering Nectar and 
Wood Eaters appeared, each specific to only one type of society). 

Chart completion task. This measure was designed to ascertain the degree to which students could (a) 
identify parallel elements within a passage, and (b) arrange these elements in matrix form (supply row 
and column headings). A key was developed that indicated all possible row and column headings and 
students were assigned scores based on the total number of correct headings they were able to supply 
for both categories. 
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The Findings 

Data analy^ focuses upon the two primary categories. Knowledge Acquisition and Transfer to 
Independent Reading, as they correspond to the questions raised at the outset: does (a) instruction, or 
(b) the type of instruction, enhance students' knowledge acquisition or their independent reading 
comprehension? 

Knowledge Acquisition-Contrast 1 (instruction) 

The results for the analyses from this cat^ory are summaraed in Table 6 and the relevant means and 
standard deviations presented in Table 7. F^ures 1 and 2 show the pattern of means. Turning to the 
main effects, it is dear that School is not a significant factor, indicating that both buildings have similar 
patterns of results and similar outcome levels. There are, however, significant effects for Treatment 
Contrast 1 throughout the entire series of dependent measures for this category; Contrast 1 is always 
s ig ni fi ca n t and strong throughout the series of regressions. Not only on the general multiple choice 
posttest do mstructed students surpass those with no instruction (R^ Change = 20; Total = 30), but 
they also do so on the more detailed daily measures (for entire Booklet, R^ Change ^ .23;T*otai ^ 
.63). This general finding is true for types of knowledge acquired as. well; students vrfio have 
participated in discussion demonstrate superior performance in terms of acquiring factuii information 
(for Booklet, R^ Change-=: .17; Total = .51), ejqilaining that information (for Booklet, R^ Change = 
.22; Total 33), and appfying it in new contexts (for Booklet, R^ Change = .1(^ Total - .44) when 
they are compared to students ^o have simply read the text material independently without the 
benefit of follow-up discussion* Furthermore, these effects are stable no matter how the various daily 
measures are summed to create other iscores.^ 

[Insert Tables 6 & 7 and Figures 1 & 2 about here] 

IVansfer to Independent Reading-Contrast 1 (instruction) 

When we turn, to the question concerning indepehdert reading comprehension, we can see that the 
pattern of findings is slightly different vrfien we trace the influence of instruction (see Tables 8 & 9). 
For independent reading of the closely related passage (Taper Wasps"), there is a ^ignifici^nt effect on 
the short answer measure (R^ Change = .06; Total = .41). For this same passage, however, the essay 
measure shows no significant effect. 

On the related passage ("Micmac Indian Sodety"), there is a significant interaction with School. A test 
of simple effects showed that the effect is significant in School 1 but not in School 2 for the short 
answer measure. There is, however, an effect on the essay measure (R^ Change = .06; Total = 26), 
contrary to the findings for the comparable measure for the closely related passage. 

In exa mining the results of reading comprehension of the unrelated passage ("Landforms'*), it is 
apparent that the effect of instruction has disappeared for both the short answer and the recall 
measures. When the material is unrelated to that of the original instruction, the instructed groups no 
longer have the advantage over the uninstnicted groups. As will become apparent in the analysis for 
Cbntrast 2, however, this effect is attributable to the low scores obtained by the Discrete group. 

[Insert Tables 8 & 9 about here.] 

Knowledge Acquisition-Contrast 2 (type of Instruction) 

As Table 6 shows, m several instances there was a sigmHcant School X Treatment Contrast 2 
interaction. Results of tests of simple effects revealed that while Integrative is superior to Discrete in 
both schools, the differen ce is more pronounced in School 2 than in School 1. 
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In terms of the total amount of knowledge acquired over the entire instructional cycle, there is a 
significant effect for type of instniction m both schools, although tiie size of the effect is much greater 
m School 2 than in School 1 (R^ Change = .07 (SI); 35 (S2)). The Integrative group demonstrates 
performance that is superior to that of the Discrete group. This finding is mirrored in the results of the 
multiple choice posttcst, a^ covering the entire instructional unit (R^ Change = .06; Total = SO). 

U we consider the kinds of knowledge acquired, the findings mdicate that students m the Integrative 
group show ^^r levels of factual knowledge than their peers in Uie Discrete grouppthey.also show 
greater facility in constructing explanations and in applying their knovdedge to new contexts, 
particularly for Schod 2. In School 1, although it is not as consistent, nor as strong, Uie same pattern 
between the two forms of instniction emerges. 

Transfer to Independent Readings-Contrast 2 (type of instniction) 

For die closely related passage (Taper Wasps"), there is a strong effect for type of instruction (Short 
Answers: Change- .19, Total = .41; Essay: Change = 26, Total = 37), mdicating a distinct 
advantage for the Integrative form of instruction (see Table 8). Again witfi the second passage 
("Micmac Indian Society), there is a strong effect for type of instruction on bodi kinds of measures: 
the advantage of die Integrative group is maintained (Short Answers: R^ Change = .18; Total = 63; 
Essay: R^ Change = .16, Total = 26). 

On Uie last passage in the scncs, "Landforms," there is a dear effect for tfie form of instruction (Short 
Answers: 11^ Change = .08, Total = 33; Recall: R^ Change = .07, Total = 33). Students who 
partidpated in tiie Integrative form of instniction demonstrate higher levels <rf reading comprehension 
tiian those who partidpated in the Discrete form, even when tiie material bears no relation to that 
priginalty discussed In addition to enhancing students* kno^edge acquiation in tiie domain of 
instnicticn, the Integrative form of instruction also influences some aspcct(s) of comprehension that 
cannot be tra^ directly to content Imo^edge. Recall tiiat tiie Landforms efifect was not significant 
^en the two instructional groups were compared to tiie Independent Reading group. An inspection 
of adjusted means (Table 8) for tiie tiiree groups reveals that the change in significance between 
Contrast 1 and Contrast 2 is due to tiie fact tiiat tiie mean for tiie Discrete group is lower tiian tiiat for 
tiie Independent Reading group, figures 3-5 show tiie pattern of group differences for tiie transfer 
passages. 

[Insert Figures 3*5 about here*] 
Secondaiy-Catqeories of Dependent Measures 

The results of tiie analyses of measures in the remaining three categories are not as straightforward as 
tiiose for tiie primary categories. Earlier it was stated tiiat the unrehability of the approach to learning 
measures preduded further analyses. For tiie Text Reference measures, tiiere are scattered effects for 
instruction and for ^ of instruction (favoring the Integrative ferm)^' but no dear and consistent 
pattern emerges. Conscquentiy, it is not possible to explain the positive effects observed in Knowledge 
Acq\iisition or in Transfer to Independent Reading by differences in tiie students' text reference skills 
or in tiieir fundamental approach to learning, at least as measured by the instruments used in this 
study. 

Differences in Kno^edge Framework measures (eg., students' acquisition of a schema for insect 
sodeties, tiieir schema for text content and text organization) do emerge; while there is no effect for 
instruction, per se, on tiiese measures, tiiere is an effea for type of instniction, with tiie Integrative 
group demonstrating more fully developed knowledge structures tiian tiie Disaete group (R^ Change 
= 037; Total = .40). Further, tiie Integrative group is better able than tiie Disaete group to extract 
superoirdinate units from text and arrange them in a fashion tiiat displays tiieir logical relations to one 
anotiier by indicating row and column headings for a matrix chart (R^ Change = .19; Total = 31). 
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The regression effects and the means and standard deviations for the measures in this category are 
presented in Tables 10 and IL 

[Insert Tables 10 & 11 about herej 

Sumiriaiy of Findings 

The results of Study 2 largely support and extend the .findings of Study 1. In accordance with the 
conviction of many teachers, discussing new content with children more readily enables them to acquire 
it than if wc simply assign new content as bdependent reading. Further, students' grasp of this new 
content is not limited to recall of factual information, but extends to include a greater proficiency in 
constructing explanations and applying kno^edge in new context. Additionally, students who 
participate in discussion of text content can use their acquired knowledge to enhance their independent 
reading of passages related to some degree to the originally discussed material 

The results of Study 2 also mdicate that differences in the form of a foUpw-up text discussion influence 
the knoi^ec^ acquisition of students and their independent reading. While either 6[ the two forms is 
more fodlitative than no instruction, the Integrative form led to greater knowledge acquisition and 
further transfer to bdependent reading than did the Disaete form of instruction* Students who 
participated in the Integrative form acquired more knowledge of all types (factual, «q)lanation, and 
application), demonstrated superior bdependent reading comprehension of both related and unrelated 
passages, and were better able to predict and describe the structure of novel passages. 

Discussion 

The r^ults of Study 2 offer dear evidence that instruction ^gnificantly enhances students' knowledge 
acquisition and their bdependent reading of material related to some degree to that of the original 
instruction. This leads us to conclude that, smcc students profit so substantially from instruction, their 
independent reading skills for informational texts are relatively weak, and that this constitutes an 
instructional problem of con^derable importance and magnitude for both teachers and students. 

Sbcc the Integrative form of instruction led to superior knowledge acquisition and bdependent 
readbg comprehension when compared to the Discrete form, we can conclude that what the teacher 
does significantly influences students' performance. Not all forms of instruction are likely to be equally 
effective. 

Although the findings of Study 2 yield a clear mdication of the general efficacy of Integrative 
instruction when compared to Discrete instruction, they offer no satisfactory explanation as to why this 
instruction was more effective. Sbce the attempt to elucidate the reasons for the differential 
effectiveness of these two Qpes of instruction through the analysis of the secondary categories of 
dependent measures was not successful, a third study was undertaken which manipulated rather than 
assessed some of the critical features of btegrativc instruction. 

STUDY THREE 

The instruction designed for the Integrative group b Study 2 was developed by superimposbg two 
quite distbct features, visual representation of text content and systematic reference to the text, on a 
pre-determbed content structure plan that guided the teacher's treatment of the text content during 
discussion. These features acted m concert to support the teacher's attempt to highlight important 
relationships b the content, one through ^isual means and the other through verbal means. 

In Study 3, the approach was to isolate these two fe2tures b order to determine which of the two, if 
cither, produced the effects associated with the Integrative form of instruction, observed b Study 2. 
The effects of most concern to account for were those associated with knovrfedge acquisition, transfer 
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to independent reading of related and unrelated content, and the acquisition of generalized knowledge 
structures associated with the content domam and with texts. 

Not all of the positive effects observed m Study 2 need necessarily have been associated with one or the 
other feature. Rather, some kinds of effects might be associated with one feature and others with the 
second feature. Generally, those effects most dosely^linked to the content of the .instructional material 
might more plausibly stem from the incorporation of the visual representation feature, while effects 
relating more to text, per se, might stem from the incorporation of the text reference feature. Hence, it 
is plausible to expect that a treatment focusing exclusively on Visual Representation might exceed one 
focusing on Text Reference on (a) the iCiowledge Acquisition measures^ and (b) the Transfer to 
Independent Reading (related content), (c) Acquisition of an Insect Society Schema measure, and (d) 
the Matrix Chart Completion task (supplying row and column headings). The treatment mcorporating 
Text Reference, on the other hand, might lead to superior performance on (a) Independent Reading of 
unrelated content, and (b) Schema for Text Organization, and to a lesser extent, the Chart Completion 
task. 

Method 

Subjects 

Subjects for Study 3 were 24 fourth-grade students drawn from one intermediate level school (grades 4 
through 6) m the same district as the two schools in Study 2. As did subjects in Study 2, all students m 
Study 3 came from self-contained classrooms* Procedures for the assignment of subjects to one of two 
treatment groups were identical to those used for Study Z Eigjit students from each of three 
participating classrooms were randomly selected and assigned to treatment group* 

Instructional Treatment Groups 

The treatments for the two groups of Study 3 were designed using the Integrative form of instruction of 
Study 2 as a reference pobt. One treatment mcorporated the \^ual Representation feature and the- 
other the Text Reference feature of the Integrative instruction from Study Z As was true for Study 2, 
the des%n for both groups m Study 3 entailed superimposing one of the features on a pre-determined 
content structure for the material Lesson plans for both groups shared the same content structure but 
differed with respect to which of the two features of the Integrative form was mcorporated. 

Plans for the Visual Representation group were developed by eliminating all the explicit text reference 
direction from the plans used for the Integrative group in Study 2. The teacher gave no explicit 
indications to students as to the appropriate sources for their contributions to discussion. Students 
were not prevented from looking back at the text; they were simply not explicitly directed to do so. 

Plans for the Text Reference group were also modeled on the Integrative instruction of Study 2. The 
content structure and treatment of content remained the same, but the use of all visual representations 
of the content was eliminated. The plans retained the direction to students to support contributions by 
locatbg specific text information and reading it aloud Also retained was the provision for extra 
guidance and support for students through teacher modeling of effective behavior to help them learn 
how to locate relevant information more efficiently. 

Materials 

The materials of Study 3 were identical to those of Study 2 with the exception of the lesson plans. The 
lesson plans consisted of the two variants of the Integrative plans for Study 2 just described. The Insect 
Societies booklet agam constituted the instructional material for the Visual Representation group. 




Gallagher & Pearson 



Discussion, Reading Comprehension, & Knowledge Acquisition - 30 



Three of the five categories of dependent measures from Study 2 were again employed in Study 3: 
Knowledge Acquisition, Transfer to Independent Reading, and Knowledge Frameworks. All scoring 
procedures were the same for both studies. Reliability was calculated for each measure only once, 
pooling subsets of protocols from each study; consequently, the same reliability levels described for 
Study 2 also apply to Study 3. 

Procedures 

As closely as possible the procedures for Study 3 replicated those of Study 2. An unused classroom was 
made available for use in Study 3, and both groups used this room for regularly scheduled class 
sessions. ^ 

As in Study 2, students were tested by classroom rather than by treatment group; the pretesting period 
was again 3 days with a 2-day orientation, and the posttesting period 5 days. 

Design and aneljsis. The design of Study 3 is simpler than that of Study 2 with the factor of school 
eluninated and only one treatment contrast, that between the two instructional features, visual 
representation and text reference. 

Precisely the same basic analysis plan developed for Study 2 was adopted for all the analyses of Study 3. 
Working again wilhm a hierarchical regression framework, each dependent measure was first evaluated 
for covariate X treatment contrast interactions. There were no such interactions. Subsequently, a two- 
step regression analysis was carried out for all dependent measures following the same progression: 

STEP 

1 Reading Ability 
Content Vocabulary 

2 Treatment Contrast (Visual Representation/Text Reference) 

3 Reading Ability X Treatment Contrast Interaction 

4 Vocabulary X Treatment Contrast Interaction 

Results and discussion. For the first category, Knowledge Acquisition, there are few significant 
differences between the two treatment groups, despite a general pattern of higher means for the Visual 
Representation group compared to the Text Reference group. The end of unit total .score (collapsed 
across all three types of knowledge) for the daily measures sho>wd significant effetts. The Visual 
Representation group acquired more knpvsdedge than the Text Reference group, but only slight 
differentiation as to type of knowledge is possible (for example, on total Booklet, R^ Change = .09, 
Total = 0.60; F(l,20) = 437; p < 05.). In terms of type of knowledge, the Visual Representation 
group was superior on the explanation questions (R^ Change = .15; Total = 0.62; F(l,20) = 7.73; p < 



[Insert Table 12 about here] 

The results of the regression analyses for measures in the second category reveal that there are no 
significant effects throughout the entire series. In short, there is no evidence of carry-over of the 
effects of acquired kno>^dedge to readbg comprehension oi related material as there was in Study 2. 
The Visual Representation group performed no differently on any of the readbg comprehension 
measures than did the Text Reference group, despite some bdication of superior knowledge 
acquisition. 



Gallagher &^Pearson 



Discussion, Reading Comprehension, & Knowledge Acquisition - 31 



The results of the regression analyses for the final category, Knowledge Frameworks, again reveal that 
there are no significant differences between the two treatment groups. We are not able to distinguish 
the two forms of instruction of Study 3 in terms of generalized knowledge effects as was possible in 
Study 2, 

To summarize, the results of the ianalyses from Study 3 do not allow us to trace the effectiveness of the 
Integrative instruction of Study 2 to one or the other of the supporting features. Before concluding that 
there are, in fact, no differences between these two forms of instruction, however, vit must note the 
small sample size and the relatively low power (less than 30) of the F-tests. Although there may, in 
fact, be no significant differences between the two treatments as the regression analyses largely 
indicate, we must regard these findings with caution. 

Post Hoc Analyses 

Settii^ aside the question of the relative superiority of the two features, there are several other 
questions which can be addressed if we look aaoss the contrasts in both Studies 2 and 3. A new set of 
contrasts was created by examining the entire array of different treatments from both Study 2 and 
Study 3. They were: {d) Instruction: Instructibn/No Instruction; (b) Co/i/enr T/^ij/me^^^ Integrative 
Treatment/Discrete Treatment; (c) Supporting Features: Two Features Combined (Integrative of 
Study 2)/0ne Feature Only (each ofthe two treatments in Study 3). 

A senes of post hoc regression analyses for a subset of the dependent measures was carried out 
controlling first for the two covariates and then evaluating the significance of the treatment contrasts. 
In the first category. Knowledge Acquisition, each of the unit scores showed a significant effect in the 
expected direction for all three contrasts. Students who had the benefit of some instruction in the form 
of a follow-up discussion acquired more knowledge than those students who simply read the material 
independently. When the teacher's treatment of the content was essentially integrative rather than 
discrete, students acquired more of the content. Finally, instruction whidi incorporated both the 
Msual Representation and Text Reference features proved superior to instruction which incorporated 
only one of those features. Figure 6 displays the differences between all five treatment groups. 

[Insert Figure 6 about herej 

For the second category. Transfer to Independent Reading, the short answer measures were analyzed. 
For the two passages related to the original content, all three contrasts were again significant, but, for 
the last passage, only the second contrast. Content Treatment (comparing the Discrete to the 
Integrative treatment), was significant. Although the critical control condition was not represented 
(integrative content structure with no supporting features) in these contrasts, the results are still 
strongly suggestive of the general efficacy of an integrative approach to novel text content when it is 
compared to a discrete approach. 

GENERAL DISCUSSION 

The purpose of this series of investigations was to learn more about textbook-centered learning in the 
content area classroom. In particular, knowledge acquisition was studied as a function of teacher- 
directed attempts to foster the comprehension of specific text content, possibly also leading to transfer 
to their independent reading comprehension. 

In the remaining sections of this paper, the major findings from the three/studies are reviewed in 
summary form; then the findings are discussed, within the limitations of this s-sries of studies, in terms 
of their implications for the broader concerns of practice. Three issues in particular are discussed in 
some detail: (a) students' independent reading of novel content, (b) the constiquences of prevailing 
practice, and (c) the consequences of the experimental altiernative to prevailing practice. 
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Review of the Findings 

The findings concerning the influence of instruction on students^ knowledge acquisition are quite 
consistent. In comparison to the uninstructed group, the instructed groups in both Study 1 and Study 2 
acquired substanti^y more knowledge. Not only did instructed students acquire more knowledge, they 
were better able to cons^uct explanations using that knowledge and to apply it in new contexts. The 
magnitude of these effects was strong and consistent throughout the series of knowledge acquisition 
measures. Further, students who participated b some form of instruction demonstrated transfer of 
acquired knowledge on tests of bdependent readbg of material that was related to that of the origbal 
instruction superior to that of students who received no teacher assistance. Again, Study 2 confirmed 
the mam fmdbgs and- trends of Study l b a strong and consistent fashion. Instruction enhanced 
students' acquisition of knowledge and facilitated their bdependent reading comprehension of related 
material. 

The fmdbgs also demonstrated that the form of instruction influenced students' knowledge acquisition 
and their bdependent reading. Students who participated b the Integrative form of instruction not 
only acquired more knowledge overall than students b the Discrete group, they also were better able 
to construct explanations usbg that knowledge and to apply it b new contexts. Additionally, 
participation b the Integrative form of discussion led to superior transfer to bdependent readbg, of 
both related and unrelated content. 

The fbdbgs from Study 3, which was designed as a follow-up to Study 2, yielded two sorts of 
information. One sort concerned the relative contributions of each of the supportbg instructional 
features, Visual Representation and Text Reference, to the overall effectiveness of the Integrative form 
of instruction b Study 2; the results of Study 3 dp not allow us to determme with any confidence the 
sources of relative effectiveness. Post hoc analyses suggested, however, that the Integrative form of 
instruction of Study 2 which mcorporated both features was more effective than instruction 
bcorporatbg either one alone. Further, the post hoc analyses suggested that any of the variations on 
the Integrative form of instruction were more effective than the Discrete form, both with respect to 
knowledge acquisition and transfer to reading comprehension of new texts. What appears to be 
warranted is an additive bterpretation of these two features. Each by itself is equally superior to no 
instruction, and the two together are about tmcc as effective as either by itself. 

Limitations 

Before considering the issues related to actual practice, the limitations of this series of bvestigations 
should be acknowledged These bclude the vulnerability of all the bvestigations to bias b the data 
collection procedures, the group size for instruction, the varjing amount of time available for each 
treatment group, the closeness of the approximation of the Discrete form of instruction to actual 
practice, the similarity between the experimental texts and commonly used school textbooks, and 
possible systematic differences that mig^t distinguish the teaching of the experimental teacher from 
that of classroom teachers. 

Although all of these limitations bear on the bterpretation we give to the findbgs concembg each of 
the three issues outlbed above, some have more relevance to one than another. For this reason, with 
the exception of the question of bias, each limitation is discussed at greater length withm the context of 
its greatest relevance. Sbce possible bias b the data collection procedures stemmbg from the fact that 
the bvestigator delivered all the mstruction and administered all the tests is a general issue 
surroundbg the bterpretation of all the results, it is discussed first. 

Because this set of studies mvolved the evaluation of mstruction, potentially it carries implication for 
the practice of classroom teachers and the training of new teachers. Taking this potential seriously 
requires that those who carry out instructional studies proceed cautiously. 
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Having many teachers cany out the experimental procedures in the course of their on-going instruction 
IS dearly the most ecologicaUy vaUd, and most readUy generalizable, approach. However, at initial 
stages of mstructional research, as was the case here, there are two primary obstacles to using 
classroom teachers. One is the difficulty in persuading a large enough n'-iber of teachers to substitute 
an experimental approach for their normal practice w^en they have no idencc that it is at least, as 
effective as what they are already doing. A second difficulty stems from th. ikelihood that aUowing the 
teacher factor to vary in random and/or uricontroUed ways wiU decrease the statistical precision and' 
pdwc^ of, the experiment. In the early stages of a line of instructional research, it is more "cost- 
effective" to err on the side of statistical power (an internal validity issue) than generalizability (an 
external validity issue). Also, in the early stages of such research, it is unlikely that relevant sources of 
teacher variation wiU be known, or, even if they are known, that there will be reUable ways of 
measunng such sources so that they may be controlled statistically. 

For the present investigations, both sorts of difficulties were present at the outset. There was no basis 
for attempting to persuade teachers to carry out the experimental procedures and abandon their own. 
And, although relevant Uterature is avaUable to help identify likely sources of- variation (those, for 
example, stemming from the materials, group size, teacher years of experience, or building SES level), 
we do not yet know how to measure some of them. For iiistance, if teachers could be persuaded to use 
the Integrative form of instruction, there would still be the question of the materials-how great a range 
would there be in terms of topic, familiarity, length, or considerateness? Using materials prepared by 
the investigator is not necessarily a desirable course for teachers as they must then eliminate part of the 
regular curriculum. 

AdditionaUy, there is the possibiUty that wide variation would stem from teacher differences. Although 
the teacher behavior of interest in these studies.was restricted to the development and delivery of plans 
for discussion of text content, there are at least two other aspects of teaching that are probable sources 
of variation: the teacher's owu content knowledge relevant to the domain of the students' inquiry and 
the teacher's manner of interacting with students during this kind of instruction. Both of these factors, 
may influence the fidelity with which the teacher delivers lessons. 

Several efforts were made to minimize potential bias in these studies: (a) testing students by classroom 
rather, than by treatment group, (b),delaying the scoring of the daUy measures untU all instruction had 
been completed, (c) obliterating all names and replacing them with numbers on students' papers,.and 
(d) collecting video tapes of all instructional sessions. Nonetheless, the essential vutaerability to bias 
particularly in conducting the discussions, still remained. The possibiUty of bias m the data coUection 
procedures must therefore be acknowledged, but in the present case of instructional research in its 
imtial stages, it is acknowledged without apology. 

In considering each of the three more general issues outlined earlier (i.e., independent reading of novel 
content, the consequences of prevailing practice, and the consequences of the experimental 

to the others. Although the a priori contrasts 
tested m the prinapal analyses provide a good deal of substantive information, they do not teU us about 
the relative effectiveness of either form of instruction when compared to students' independent 
reading. With the exception of the final transfer passage results ("Landforms"), the means of the three 
groups preserve the same ordering: Independent Reading < Discrete Instruction < Integrative 
Instruction. To gain a sense of these differences, effect sizes were estimated using the adjusted means, 
'ihese results are shown in Table 13. 

[Insert Table 13 about here.] 
Independent Reading of Novel Content 

Although content area reading is generally considered to be "difficult" for a variety of reasons 
(mduding unfamiliarity with discourse type, unfamiliarity of content, lack of appropriate study skills). 
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currentiy there is littie evidence to document the scope of the problem, if bdccd there is one. We 
know something about students* mdepcndent reading of sbgle brief passages, but we know very Uttle 
about their comprehension of larger units, spannmg the length of a textbook chapter on one topic The 
results of both Study 1 and Study 2 offer clear evidence that students have trouble with this sort-6f 
independent reading; they profit substantially from teacher assistance. As Table 5 bdicates, studenU in 
either one of the instructed groups acquired more knowledge about the domain of insect societies than 
did students who simply read the material bdepcndently. Before concluding Uiat all content area 
reading is apt to be problematic, we can attempt to qualify the general findii^ of the present scries of 
bvcstigations: Do we have any information about the conditions under which this type of reading is 

apt to be difficult? jrp^ uuigu. 

Before proceeding further, we must return to the earlier observation about the disaepancy m the total 
amount of time available to cach.treatment ^oup, Students in the Independent Readbg group spent 
approxbiately 15 mbutes with the text material, while students b die two instructional groixps spent 
approximately twice that, or 30 minutes. 

Students b Uie Independent Readbg condition were allowed as much time as they wished; as it 
happened, tiiey did not ask for longer than 15 mbutes. Some students used the available time to read 
the material more than once; others read very slowly. Still otheis finished comparatively quickly. As 
no formal records were made of students* use of time over the course of tiiesc studies, it is not possible 
to estimate either the extent or the consequences of this variation. 

While students were free to ask for assistance b pronouncing words, and did so, it is worth noting thai 
at no time did any of the bdepcndent students ask whether or not Uiey could underlbe portions of the 
text, pr take notes. This brings us to a consideration of the differences, if any, between readbg and 
studybg text, and equally importantly, the students* awareness (or lack thereoO of these differences. 

Assuming for the moment that there is a difference between readbg and studying and that Uie 
instruction fostered improved studying rather than reading behaviors, we must acknowledge tiiat the 
comparison between the instructed and uninstructed students may not be entirely appropriate. Had 
students b the bdepcndent group been given feedback about how they were dobg on the daily 
measures and an opportunity to discuss more effective strategics for improvbg tiieir performance, they 
might have been able to bducc more effective study skills. This, oif course, is an empirical question and 
can be explored b future work. 

A final comment about the appropriateness of the comparison between instructed and uninstructed 
students concerns the assessment of transfer to independent readbg. For all three transfer passages, 
students in all treatment groups engaged b bdepcndent readbg under precisely the same conditions 
that obtabed for tiie Independent Reading group durbg tiie btervcntion period. While one may argue 
that a bias toward tiie instructed groups may have existed for tiie knowledge acquisition measures, no 
such argument <^ be raised for these transfer measures; hence tiie bterpretation of existbg group 
differences favorbg instruction (especially Integrative instruction) is straightforward. 

Rctumbg now to a consideration of the conditions under which bd^pindent readbg of novel content 
is apt to be difficult, it is important to exambe tiie materials. Although tiie comparability of the 
materials is an issue for the instructed groups as well, it is particularly biportant for tiie bdepcndent 
reading group. How do these insect society materials compare wth otiier materials fourth-grade 
students are likely to encounter during instruction? Is there any reason to believe that these materials 
are any more or less difficult than others they may encounter? As noted in the description of Study 2, 
the readability levels, usbg both the Dals-Chall formula and the Fry formula, were calculated for each 
section of tiie Insect Societies booklet. These results are shown b Table 5. As Table 5 bdicates, tiiere 
is a range, using either fonnula, of grade 4 to grade 8. Earlier, some of the problems of usbg these 
formulas with expository material were discussed, with the suggestion that estimatbg actual difficulty 
through the use of these formulas was probably not feasible (Cohen & Sternberg, 1983). In preparbg 
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the materials, then, a decision was made to allow readability level to vary, but to attempt to contr A 
section length* 

At the conclusion of the study a foUow*up analysis was carried out on the various elements of the 
readability formulas and their relationship with major dependent measures. Allowing for the 
pos^bility that any relationship might differ with instructional treatment, separate analyses were 
carried out for each of the treatment groups of Study 2, as well as for the overall sample. 

The predictors of readability included section length and, from the Dale<3ia.U formula (Dale & Chall, 
1948), words per sentence, number of unfamiliar words, and the Dale-ChaU score. For the Fry formula 
(Fry, 1968) the predictors included were number of sentences and number of syllables per 100 words. 
The set of simple correlations between predictors and group means reveals a strong association 
between section length and number of unfamiliar words with each other (i « .25) and with the set of 
g^oup means. In no case, however, did cither of these prcdidtors or any of the others expUin a 
significant amount of variance m any of the group means. Longer passages then, are associated with 
higher levels of unfamiliar words, and both are associated \^th lower means on the outcome measures, 
although the association is not statistically significant. 

Length is probably the more reliable measure of difficulty since the Dale-Chall unfamiliar word 
counting procedures allow for no correction for recurrences of the same word throughout the scries of 
passages. In effect, this serves to inflate the unfamiliar word scores (Cohen & Sternberg, 1983). 
Further, since the unfamiliar words are apt to name concepts, attempting to reduce difficulty by 
replacing them with more familiar synonyms (if available) might adversely affect the precision of the 
original language and/or add additional verbiage to explain concepts for \^ch no familiar word labels 
are available. 

the average passage length for these materials ia 540 words. The question of interest then is how this 
compares to the amount of content typically covered in normal practice. For tl^ we have only mdirect 
evidence from some of the observational work described at the outset Teachers reported m the 
Gallagher and Pearson (1982) study that they normally spent 2 to 3 weeks covering one textbook unit, 
which usually was a chapter. Estimating chapter word count to range between 4,000"to 8,000 words, 
depending on publisher, the amount of content covered b this study iswithin the normal range. 

The only other index available from the present set of data is one of the degree of novelty represents 
by the instructional materials. Reasoning that students may.klready know more about some domaias 
than others, and that materials about the more familiar domains are likely to be "easier," coupled with 
the important role prior knowledge has been observed to play during the comprehension process 
(Johnston, 1981), novelty presents itself as a reasonable index of difficulty. Using the multiple choice 
pretest performance as an index of novelty we can conclude that the instructional material was indeed 
novel; pretest.means were near chance. Again we can ask whether students are apt to encounter a 
comparable degree of novelty b normal practice. Unfortunately, we are unable to answer the 
question; consequently we must be content to qualify the general fmding of the present work by 
suggesting that vAcn students encounter material of a high degree of novelty, they benefit substantially 
from teacher assistance. Whether or not the same advantage would accrue with less novel material is 
still unknown. 

One fmal observation about the relative difficulty of the instructional materials concerns their 
considerateness-how transparent they render the underlying conceptual structure of the kno%^edge 
domab. In the preparation of these materials, care was taken to ensure that they were good examples 
of informational text; b short, the objective was ronsiderateness. In the Brooks and Dansereau (1984) 
work dted earlier, the authors report a fadlitative effect for text organized according to the underlybg 
struaure of the knowledge domab. Interestbgly, the fadlitative nature of considerate text does not, -n 
their work, depend on training in the recognition of that structure; studenU workbg on their own 
benefit^ from considerate organization to the same extent that trabcd students did. In the present. 
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study, wc can obseive Uiat when the instructbnal materials bcluded considerate text, instruction 
enhanced performance. What the Brooks and Dansereau Tuidings lead us to suggest further, however, 
is that in comparison to other materials students may encounter, the relative difficulty of those used b 
this study stemming from length or novelty might be offset by their level of considerateness. 

To summarize then, we can conclude that the present set of findings strongly suggests that fourth-grade 
studenU profjngreatly from teacher assistance b copmg with their content area textbooks. Acquiring 
knowledge soi ily from text is difficult. By extension, enabling students to use reading skill as a tool for 
knowledge acquisition represents an instructional task of considerable proportion and importance. 

Prevailing Instructional Practice 

From these results, wc know that b comparison jo a Read Only conUol group, the Disaete form of 
instruction enhanced students* performance, particularly b terms of the amount and kmd of knowledge 
they acquired In extending these findings to commentary on prevailing instructional pnftciice, we 
should consider carefully several of the issues that may affect generalizability. First is the/ question of 
how closely th^ Disaete form of instruction actually approximated classroom practice as we described 
it at the outset. In attempting to do this wc are hamper ;d by the paudiy of careful description of 
practice that relates the verbal exchange to the text material being discussed. Only the Smith and 
Geoffrey (1968) work be^ns to tie the two together, and even b this work, wc do not have an example 
of an entire text being discussed for the whole of one lesson; instead, we have data only for brief 
segments. 

The Disaete instruction, modeled on descriptions of conventional practice, probably resembles it b 
broad outlbe, but not b every particular. In the course of on-going practice, teachers can be expected 
to deviate b particular ways from the format used here, some of the time. What probably wiU not 
change, though, is the real limitation placed on teachers when the first decision is to btroduce topics 
according to order of presentation b the prose without any provision for differential emphasis. The 
Disaete form of instruction then, is probably best characterized as a close approximation to much of 
conventional practice. 

A second issue is group size. Content area instruction at the elementary level is ordinarily delivered to 
the whole class rather than to smaller groups, as was the case b these studies, although the 
heterogenous composition of the whole class was preserved. Sbce there is substantial evidence that 
group size docs influence instruction b many ways (Dunkb & Biddle, 1974), the small group size of 
these studies represents a serious threat to the external validity of the current findbgs. Wc simply 
cannot predict whether or not the same pattern of findings »vould occur with whole classes. 

A third issue rs materials. >yould the same pattern of findbgs obtab with more or less considerate, 
btercstmg, or novel materials? Again, we r annot resolve these questions based on the present work; 
we can only raise them as constraints on the interpretation of the current findings and areas for future 
exploration^ 

Despite the limitations mentioned, the results do indicate that instructional practice that resembles the 
Disaete fon^ of instruction will enhance students' performance when compared to allowbg students 
to work on their own, but not when compared to instruction fostering btegration aaoss text segments. 
In attemptbg to undersUnd why students who participated b the Disaete form of instruction acquired 
more knoM^edge than studrats who simply read the material bdepcndently, wc can dtc ♦he fact that 
the oral readbg during class constituted, b/jffect, a re-readbg. Further, the focus on one paragraph at 
a time may have suffidenlly narrowed the focus for students so that they could attend to specific factual- 
information. In fact, the Disaete form of instruction affords students a high degree of redundancy of 
text information. This, coupled with the fact that the independent readers had neither the advantage of 
redundancy nor the possibly clarifying value of a group discussten mih their peers, may account for the 
observed differences in factual knowledge acquired. 
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It IS less clear how to account for the diifferences b students* abilities to construct cxpIanaUous and to 
apply their knowledge in new contexts. It may be that the latter two depend to a large extent on a 
Tinner grasp of factual knowledge than the independent readers were able to gain. Similarly, 
^ comprehension of related material (Taper Wasps" and The Micmac Indian Society"), may depend in 

part on a firm grasp ci relevant factual information. When the passage was about unrelated content 
("Undforms") the differences between the Disaete group and the Independent Reading group 
disappeared. Whet students gamed from the instruction did not extend to comprehension of unrelated 
material. 
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To summarizs then, we can, within the limitations already discussed, conclude that conventional 
instructional practice, represented by the Discrete form of instruction in these siudies, substantially 
enham^ studenu* knowledge acquisition, w*en they are encountering novel content. Further, the 
effectiveness of the instruction extends to students* independent rea<Ung of m'-erial about content 
related to that of the ori^ instruttipn. In many respects then, the prevailing ins iirtional practice m 
content area classrooms has positive effects. Teacher assistance helps students acquire more 
knowledge to a degree sufficiently firm to enable them to use it during independent reading of related 
material. The pt«vailing practice may not be as effective as the Integrative form; however, it is 
certainly superior to leaving the students "on tLeir own." 

Experimental Instruction-Intention 

As we have seen, vAch students have little priokknowledge, the teachePs approach directly influenced 
students' knowledge acquisition and independent reading comprehension. Why? 

Students w*o partidpated in the Integrative form, of instruction e3q)eriencec exposure to the text 
content designed to heighten their awareness of the interrelationships among the concepts both vwthin 
and agoss separate segments of text while at the same time attending to factual detail relevant to 
important concepU. The teacher organized discussion to highlight important relationships and 
remforced U by providing a visual representation. In contrast, the Discrete form offered exposure to 
t« content that was essentiaUy serial or list-like Proceeding through the text one paragraph at a time 
added nothing to the properties of the prose itself. Students in the Discrete group could benefit, then, 
to the that they themselves were able to induce and use structural elements reUting to insect 
societies ui general. 

WhUe the Discrete form of instruction did provide a high degree of redundancy, the Inte^aUve form 
stiU led to greater knowledge acquisition. RecaUing our earUer discussion; of knowledge acqiiisiUon 
processes, a plausible explanation is that the Integrative form helped students modify or create a 
framework for organizing and relating the information they encountered while the Disaete form did 
not. It is further possible that the Discrete form, through the practice of breaking up the information 
into smaU units, actually interfered -.vith students' attempts to build frameworks, perhaps even 
inhibiting the potentially factlitative nature of the prose itself. So that, even though the prose was well 
structured, the Disacte form of instruction may have prevented students from taking advantage of it. 

Some of the pwt hoc analyses of Study 3 support this interpretation. Comparing aU the groups based 
on the Integrative plan for topic introduction and discussion to the Discrete form, the Integrative plan 
groups perform at higher levels than the Discrete group. This suggests that the integration of main 
concepts mtrinsic to the plan is itself a strong factor in students' learning. 

Earlier, the very low pretest means were mentioned. This meant that a range of knowledge levels, 
from low to moderate to high, did not characterize students' prior knowledge. In other domains, this 
might not be the case. Had there been a range of knowledge levels, as one would expect m most 
comeni area classrooms, it is not at all clear from these findii^ whether or not the same pattern of 
results would have been apparent. If the most important aspects ot the Integrative treatment were its 
potential for highlightbg relationships between important concepts and for creating a framework for 
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interpreting information, it might not be as effective when students ahready possess the appropriate 
framework, i.e., when the topic is ''familiar.'* 

In other words, when prior knowledge levels are higher, so, too, is the structural completeness of the 
knowledge 'framework or schema that represents it, and hence the students might be less m need of 
assistance from the teacher. For students with hi^ levels of prior knowledge, then, the considerate 
organization of the prose itself, coupled with the explicit exposure of factual detail b the Discrete form 
of instruction might be equally as effective, if not more so, than the Integrative form. Of course, when 
speaking of underlymg representations, we must be careful to pobt out that the structures that we have 
described reflect both text content and the organization of discussion topics. Both in turn reflect the 
underlying conceptual structure (at least to some degreeXotthe knowledge domain itself. In fact, one 
thing that be;came dear in conducting these studies was that this knowledge structure may not be 
bdependent of text structure b any important way. It may, however, be at best only a close 
approximation to the individual's underlying knowledge structure; they are by no means necessarily 
identical. What the teacher m the Integrative form of-instruction provides is a framework for students 
to use that may cobdde dosely with the student's akeady existbg schema, may bear some resemblance 
or no resemblance to an akeady existing schema, or may necessitate the creation of an entirely new 
schema for the student. 

A comparison of the findings from Study 1 and Study 2 provide some pertment information. In Study 
1, there was a greater range of prior knowledge levels represented. It was possible then for 
knowledgeable students to benefit from the Discrete instruction more than less knowledgeable 
students. But, there was no prior knowledge by treatment bteraction, at least for a reladyely brief 
instructional pcridd. Although the brevity of the instruction (limitbg the number of occurrences of the 
overall insect sodcty structure) should not be minimized, the fact that there was no prior knowledge by 
treatment bteraction in Study 1 suggests that even for more knowledgeable students, Disaete 
instruction may be less facilitative than the Integrative. 

One of the prindpal reasons, then, for the facilitative effects of the Integrative form of instruction may 
be that it provided an organizbg framework for students. Precisely how such a framework influences 
knowledge acquisition is not dear, however, and we must further qualify our conclusions with the 
recognition that this particular pattern of results may apply only to situations when the information that 
students encounter is truly novel to them and vyhen the instructional cycle is at least 2 weeks long. 

The results of the analyses of the Insect Society Schema Acquisition measure from the Knowledge 
Frameworks category suggest that, at least for the domain of insect sodeties, students in the Integrative 
group developed schemata that more dosely cobdded with the overall struaure of the instructional 
material than did students b the Discrete group, lendbg some credence to a "framework facilitation" 
bterpretation. 

To conclude our comments about the experimental instruction, some discussion of the two supportbg 
features of Integrative instruction (visual representation andJext reference) is b order. Sbce the 
visual representations closely paralleled the text organization and the underlying conceptual structure, 
the Text Reference feature may have helped students recognize the fact that important column or row 
headbgs on a visual representation organized in matrix form corresponded to subsections of the prose. 
Further, as students went back to the text to clarify or Verify various pobts during the discussion, their 
awareness of this coiTc^ndence may have been remforced. So, at the level of passage and unit 
structure, the combbation of the two features may well have been hutually reinforcbg b helpbg 
students to see overall structure and how the text presentation reflected that structure. The superior 
performance of the Integrative group on the Predictions of Text Organization b the Knowledge 
Frameworks category lends support to this bterpretation. 

Together, these two features helped to shape lessons that had very concrete activities to purposefully 
engage students (creating and filling in a chart) and a manageable strategy for participatbg b these 
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activities (referring to the text). How coherent and manageable instruction seems to students is always 
a concern, but may have been especially important in this study, when a novel form of instruction was 
being compared to one that followed a very familiar and predictable format* 

Transfer to Independent Reading 

Previously we observed that the Disqrete group*s mdependent reading comprehension demonstrated a 
firm enough grasp of4he^instnictioral material to influence their comprehension of related material. 
The Integrative^ giroup demonstrated superior comprehension oh both the Paper Wasps and the 
Micmac Indian Society passages. One could argue that the transfer to these two "schema-related- 
passages reflects the fact that the Integrative group developed a stronger "sodety" schema than the 
other groups did. This explanation cannot, however, account for their superior performance on an 
unrelated passage ("Landforms"). What advantage have these students gained that is not strictly 
content-dependent? 

Two characteristic practices of the Integrative form pf instruction may help to answer this question, the 
preparation for silent reading and the systematic reference to the text Each day. before students read 
the text, they were given an orienting question by the teacher. Discussion commenced with the 
students* comments on whether or not they had found some pertinent information in the text. As the 
instruction progressed, students began to generate their own questions before readiiog, most often 
usbg transparencies showing related content to help them formulate questions. Additionally, the 
teacher directed them to look at the sections of the text to get an idea.of.the sorts of information that 
they would encounter, and to relate that to previously covered material. So, each day, as students read 
the material silently, they were domg so.with a specific purpose and with an awareness of the major 
topics present in various subsections as they related' to their purposes. In contrast; although the 
students m the Discrete group had just as much practice in silent reading, they read vrithout help in 
defining their overall purposes or in detectbg the organizational structure of the text Instead, they 
had purposes specific to each text section without reference to the entire accumulation of material 

In this regard it is disappomtmg that the Approach to Learning measures provided no useful 
information. Since they were designed to assess the kind of content-mdependent behaviors that we are 
bterested in, they might have fiirthered our understanding of the ways m which the Integrative 
treatment fostered mdependent reading skill. Nor can we turn to the Text Reference measures, smce 
there are no differences favoring the Integrative group. There are two measures from the Knowledge 
Frameworks category, however, that suggest that the Integrative treatment fosters students* abilities to 
detect and use the superordinate structure of 'he text that might in turn enhance their mdependent 
reading. The fact that students could predict rganization of a new text, together vrith their ability 
to extract siipcrordbate information from a text m order to label the rows and columns of a matrix 
chart, suggests that the Integrative treatment did bdeed sensitize students to the way m which the 
overall organization of any text can reflect the underlying conceptual structure of the knowledge 
domab. 

An unanticipated consequence of adopting the Integrative form of instruction was that some students 
began to use their Study Guides to organize spontaneous notetaking during silent readbg toward the 
end of the instructional period. They Ihen contributed to class discussion on the basis of the notes they 
had taken. This ^suggests that for some students at least, feadbg had become highly purposeful, 
mvolving attentiou to detail within a superordinate framework, ?n a way that they could themselves 
control. This type of behavior may have carried over to ip* pendent reading. 

Taken together, the comments we have made about the reasons for the effectiveness of the Integrative 
treatment m fosterbg both knowledge acquisition and independent readbg comprehension suggest 
that it is a constellation of features that operated to foster different aspects of both the knowledge 
acquisition and the comprehension process. And it is the collective impact of the entire constellation 
that produced the facilitative effects rather than any single feature. 
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Reasons for the Persistence of Prevailing Practice 

Havii^ discussed the variety of ways in which the Integrative form of instruction is more effective than 
the Disaete form, and some of the probable sources of this effectiveness, we should be m a position to 
make some suggestions about practice. But, without considering some of the reasons for the 
persistence of conventional practice and some impediments to changing it, such suggestions would be 
premature, if not altogether misplaced. Indeed, it was through listening to teachers who taught in this 
conventional fashion voice their concerns and frustrations that many of the ideas underlying the present 
work began to take foot. 

One of the primary reasons for the persistence of prevailing practice through many decades of 
American education is its very presence and prevalence. It is, after all, the form of instruction students 
^are most lUcely to observe while m school, m training, and as neophyte teachers. Not much m the way 
of alternative training seems to be available, cither through education courses or teachers' manuals that 
accompany published textbooks (Askqv, 1982). 

A second source of persistence may be the textbook itself. The textbook need not be treated as a 
"script" to permit students to "hear the text," as some have described it; indeed, the present data suggest 
that oral reading is not a necessary component of effective instruction. But m view of some of the real 
consti^ts imposed on content area instruction,;oral reading of the text (the most readily avsulable 
material) ^icscnts itself as the most feasible solution. And, as we have seen, if the i^indpal otjcctive is 
to ensure that students do bdecd acquire content, it is far superior to sunply e^qpecting them to acquire 
it on their own. 

A third, and perhaps the most serious sbgle constraint operating during content area instruction, is the 
Umited amount of instructional time available. Three 40-minute class periods per week for social 
studies and two fonsdence instruction are generous by some standards. In this limited period of time, 
teachers are expected to cover an enormous amount of content as defined by the textbook contents for 
each grade level, yfbich constitutes the "curriculum" for these subject areas. Beaaise time is so limited, 
teachers have not the luxury of grouping for instruction, and so they must expose students representing 
a wide range of knowledge and readhig levels to the same material simultaneously. 

Viewed from this perspective, prevailing practice seemt^lo be a very pragmatic adaptation to very real 
constraints. First, it is efficient b that it virtually guarantees that most, if not all, the text information 
be exposed, making it accessible to those students who have great difficult reading. Next, it allows 
those students who are more knovidedgeabk to contribute often enough, without penaliang or slighting 
their less knowledgeable peers, to clarify important points so that the teacher does not always assiune 
the role of "telling" the students what is b the textbook. Fbally, the format of such instruction is very 
familiar to students, mbimizmg time that must be spent organizbg them for inftructipc and 
mamtainbg order. 

A final reason concerns the ease of planmng for this kind of instruction, as well as the relatively 
undemanding nature of the delivery of instruction. In the course of an extremely aowded clebentary 
school day, the burden of planning for multiple groups b multiple curricular areas quickly apjiroachcs 
an unrealistic IcyeL It seems understandable that teachers would naturally reserve a good deal of their 
planmng effort for those curricuuir areas that command the greatest pubVc attention, strictest 
accountability, and the most instructional time-readmg and mathematics. 

Impediments to Attempting to Change Practice 

There are several reasons for the persistence of prevailbg practice, some outside the teacher's control 
altogether. These and other factors constitute impediments to attemptmg to tliange practice. Apart 
from the reasons cited earlier, there may be other impediments to any change effort. Even if a teacher 
chose to modify his or her practice, there would be the ubiquitous problem of infrequent or nonexLnent 
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professional attention and support to inform and guidcahc teacher b that effort. In the case of the 
present work, though, there arc two primary impediments. One stems from the way that "reading^ 
instruction is usually conceptualized. The other concerns the dominance of textbooks that cover a 
great deal of conteut, even at the fourth-grade level, b a less than considerate fashion. 

As reading instruction is currently conceptualized, we devote approximately 3 years to helpbg students 
acquire bc^nning level reading skill, and we provide them wiUi a good deal of exposure to narrative 
tex*5. As students get older and move bto the btermediatc grades, they still read many narratives 
during "reading' instruction, but they bepn to develop literary appreciation skills, and cease working on 
the lower level skills Uiat characterized earlier instruction. At the same time that sa'dents slop being 
instructed in ''how to read,* they bepn content area instruction (fourth grade), which, as we have said 
repeatedly, is textbook dominated. Prior to that time, their pf eparation for this sort of reading has, to a 
large extent, consisted of limited exposure to expository texts and an equaUy limited cycle of instruction 
aimed at strengthening content area readbg skills. If large amoijnts of time continue to be allocated to 
Uiis particular kbd of reading instruction, and teachers contmue to have limited time to cover extensive 
quantities of material, teachers will have greac difficulty attempting to adopt the Integrative 
instructional procedures. 

if, on the other hand, either content area instruction were to be given higher priority, and/or the 
fundamental design of die reading curriculum were to be modified to bdude the present sort pf 
instruction as reading instruction, practice might change to mcorporatc >irfiat certainly appear to be 
more effective practices tiian die present ones. Then, teachers mi^t be abte to deal witii a connected 
body of content on a daily basis witii smaller groups of students for entire d^ss periods. 

The current practice in reading instruction of teaching a limited set of istudy skills wth a series of 
unrelated passages is unlikely to pruve as effective. In contrast to much of tiie Work aimed at 
improving study skills^ and tiie approach by most published reading programs, the prcscJt work 
approached student performance tHmi^.z spedfic bpdjr of content rather than indepenikntfy of a 
specific body of content. The materials used wiih these fourtii-grade students were of real 
consequence, not merely serving as practice materials. 

Sbcc much of the previous work that helped to shape the development of the btegrative discussion did 
focus on the development of content-bdeFendenl\ skills, we can return to some of our btroductory 
discussion to attempt .to characterize the present work b relation to it. In examining tiie present 
findings, we can say tiiaJ, m general, tiie practice of hawng die teacher initially assume tiie burden for 
applying "siady skills* proved an effective one. Teacher-guided discussion can function as an 
opportunitj%fof quite systematic analysis, or study, of die text In diis sense, dien, bodi die Discrete 
and die JotegTdtive treatments can be characterized as attempu to extemcJiize 'm a group forum what 
must ultimately become an internal studying process. We might say dien diat die Disaete treatment 
resembles a_ studybg strategy of rcreadbg or copious underlining, while die Integrative parallels the 
more effective techniques dwt extract and exploit both knowledge and text structure at various levels. 

We can argue then diat die Integrative form of instruction was effective as a form of "group studybg," 
and led to facilitation of bodi knovdedge acquisition and reading comprehension. The fact diat these 
results vz-erc achieved widi instruction diat focused on specific content is espedally notewordiy. First,, 
the instruction influenced reading comprehension wthout sacrificbg valuable instructional time 
available for helping students acquire knowledge about important content areas. Second, die results 
suggest diat such an approach may well constitute a firm foundation for later instruction b content- 
bdepcndent, more vndely generalizable strate^es. 

The findbgs of the current study do strongly suggest that we reconsider our instructional goals for 
reading znA for the content areas; we must weigh carefully how much our students are learping about 
learnbg m our classrooms. We conclude wth a conviction th Awhile die present findb^ do carry 
implications for changing practice, die bv ^.n for realizing those changes must not be presumed to rest 
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solely with the teacher* Efforts at aU levels-the classroom, the school, the district, the university 
classroom, and the publishing houses-will be needed to achieve the reform necessary to help students 
"read to ieam/ 
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Table 1 



Means and Standard Deviations'" - Knowledge Acquired - Study 1 (N = 48) 



Group 



Pretest 



Day 
1 



Day 

2 



Day 
3 



Day 
4 



Day 
5 



Posttest 



Reading Only 



8.83 
(4.09) 



6S» 

(3.29) 



6.73 
(2.76) 



3.33 
(2.96) 



4.42 
(3.12) 



4.67 
(2.57) 



ItOO 
(5.13) 



2 

Discrete 



9.17 
(3.56) 



9.64 
(6.65) 



9.17 
(3.38) 



7.67 
(3.70) 



8.00 
(5.00) 



9.00 
(2.93) 



14.92 
(535) 



Integrative 
w/oTextRef. 



8.83 
(3.30) 



7.33 
(5.80) 



6.2/ 
(3.44) 



7.27 
(3.50) 



8.25 
(4.85) 



8.00 
(2.83) 



14.75 
(4.47) 



Integrative 



8.17 
(4.95) 



10.45 
(4.57). 



9.82 
(2.60) 



9.36 
(2,84) 



8.67 
(3.92) 



8.91 
(339) 



15.75 
(5.08) 



Standard Deviations in parentheses below means 



50 



ERIC 



Table 2 

Means and Standard Deviations* • Transfer to Independent Readine • Study 1 • 
RELATED PASSAGE - TERMITE SOCIETIES (N = 48) 



Group 


Short Answer 


Similarities and Differences 


i 


11.17 


6.17 


Reading Only 




(4.37) 


2 


14.00 


7.58 


Discrete 


(4.09) 


(2.84) 


3 


(12.45 


8.55 


Integrative 


(537) 


(3.11) 


w/o Text Ret 




4 


14.50 


7.92 


Integrative 


(4.21) 


(4.23) 



Standard Deviations in parentheses below means 



f 



51 

ERIC 



I 



Table 3 

Means and Standard Deviations* • Text Reference • Study 1 (N = 48) 



Group 


Pre 


Locating Information 
Speed 

Post 


Accuracy 

Pre 


Post 


Using Subheadings 

Identification 
Judgment of Subsections j 


1 

Reading Only 


6.04 
(155) 




5.28 
(239) 


8.17 
(2.29) 


7.75 
(2.14) 


9.33 
(2.35) 


4.67 
(1.92) 


2 

Discrete 


7.88 
(1.51) 




4.91 
(1.46) 


833 
(2.53) 


8.58 
(334) 


9.17 
(3.88) 


3.67 1 
(2.77) 


3 

Integrative 
w/oTextRef. 


6.13 
(.94) 




5.53 
(2.14) 


7.67 
1(2.99) 


8.50 
(2.15) 


11.30 
(2.41) 


4.80 1 
(2.74) 1 


4 

Int^ative 


7.89 
(2.31) 




5.79 
(2.70) 


7.75 
(2.73) 


9.17 
(237) 


11.17 
(2.52) 


6.42 1 
(2.11) 1 



Standard Deviations in parentheses below means 



ERIC 



ERIC 



Table 4 

»2 



R'' Change Associated with Treatment EfTects • Study 1 (N = 48) 



Prior 
Knowledge 



C, 



Total 
r2 



Knowledge Acquired 

Day 1 .48'* 

Day 2 .46"* 

Days .47" 

Day 4 .46'* 

Days .28'* 

Posttest .54'* 



.04* 

.05" 
.23"' 
.10*= 
.22" 
.13" 



.005 
.002 
.02« 
M6 
.002 
.016 



.03 

.10*= 

.003 

.005 

.017 

.004 



.56 
.61 
.72 
.60 
.52 
.68 



Transfer 

Short Answer .36** 
Similarities/ 
(Differences .23'* 



.06'' 
.05 



.009 
.006 



.03 
.005 



.29 



Text 



Locating Info. 
Speed 
Accuracy 

Using Subheadings 

Judgrnent 
Identification 
of Subsections 



.28" 
.48'* 



.019 
.04 



.03 
.002 



.021 
.02 



.06* 
.16*= 



.osr 

.000 



.02 
.001 



.40 
.55 



.11 
.16 



Contrasts 

Cj Instruction/No Instruction (2, 3, 4/1) 

Cj Discrete/Integrative (2, 4) 

C3 Te:ct Reference/No Text Reference (2, 4/3) 

*Bi.l0 
''b<.05 
Si. 01 
< .001 



Tables 

Readability Levels of Instructional and Transfer Texts 







Dale-Chall 


Dale-Chall 


Fry 

Cnnt 

ocni 


Fry- 
dyiiaoics 


Fn 

O.l 


Introduction< 














(1) 


697 


5.96 


5-6 


7.6 


148 


7 


(2) 


521 


6.4S 


7-8 


?.l 


143 


7 


Ant Societies 














Day! 


508 


5/4 


5-6 


7.6 


131 


< 


Day 2 


510 


6.53 


7-8 


7.1 


134 


6 


Day 3 


605 


5.88 


5-6 


&1 


125 


4 


Day 4 


497 


5.44 


5-6 


63 


140 


7 


Bee Societies. 














Dayl 


500 


5.44 


5-6 


8.8 


125 


4 


Day 2 


511 


6.99 


7-8 


7.8 


144 


7 


Day 3 


571 


6.10 


7-8 


6.7 


136 


7 


Day 4 


560 


5.00 


5-6 


7.6 


121 


4 


Termite Societies 














Dayl 


602 


6.90 


7-8 


8.8 


136 


5 


Day 2 


490 


6.88 


7-8 


6.9 


135 


6 


Day 3 


534- 


732 


9-10 


7.8 


141 


7 


Day 4 


599 


6.6J 


7-8 


7.8 


126 


5 


Pajx^r Wasps 


669 


6.48 


7-8 


7.4 


130 


6 


Micmac Indians 


677 


537 


5-6 


7.0 


125 


5 


Landforms 


414 


6.32 


7-8 


7.9 


145 


7 



Note : Scores reported are average of 2 samples/passage 



Tabled 

Knowledg , Acquired: Summary of Change Associated with Treatment Contrasts 
• Study 2 



Dependent 


Contrast 1 


Contrast 2 






K Lnange 


Change 


Total R'' 


Booklet^ 










.17 


.15 


.51 


Explanation 


.22 


.11 


.53 


Application 


.10* - 


.10*S 


.44 


Total 


.23 


.17* 


.63 


Multiple Choice 








Posttest 


.20*S 


.06 


50 



F value significant 
S School by Contrast interaction 



Contrast 1: No Instruction (Independent Reading)/Instruction (Discrete and Integrative) 
Contrast 2: Discrete Instruction/Integrative Instruction 



Table? 



Means*^ and Standard Deviation s** > K nowledge Acquired - Study 2 



Dependent Measure 



Independent 

Reading 
No Instruction 



2 

Discrete 



Integrative 



2&3 
Instruction 



Multiple Choice Posttest 


23.71 
(9.24) 


[23.17] 


32.17 
(10.92) 


[31.25] 


3838 
(938) 


[3832] 


3527 
(10.54) 


[34.87] 


Booklet (1-12) 
Factual 


33 

(.12) 


133] 


.41 
(.10) 


,[•40] 


(.18) 


[56] 


.48 
(.16) 


[.48] 


'Explanation 


.21 

(.11) 


[21] 


32 
(.13) 


[31] 


.45 

(.17) 


[.45] 


.39 
(.16) 


f391 


Application 


01 
(.11) 


[.21] 


.26 
(.12) 


[.25] 


.37 
(.16) 


[35] 


31 
(.15) 


[31] 


Total 


27 
(.11) 


[.27] 


.38 
(.12) 


[37] 


.54 

(.16) 


[54] 


.46 
(.16) 


[.46] 



Observed M followed by Adjusted M in brackets 

♦ 

Standard Deviations in parentheses below Observed A/'s 



FRir 



56 



Tables 



Means' and Standard Deviations** - IVansfer to Independent Reading - Study 2 



Pcpendent Measure 



Independent 
Reading 



2 

Discrete 



Integrative 



2&3 
Instruction 



Closely Related Passase 
Paper Wasps 
iShort Answers 

Similarities and 
Differences 



1039 
(5.19) 

2.92 
(1.97) 



[10.77] 
[224] 



1135 
(634) 

2.50 
(1.50) 



[11.01] 
[2.54] 



17.43 [1739] 
(5.25) 

5.21 [5.17] 
(2.48). 



1439 [14.27] 
(6.67) 



3.85 
(2.48) 



[3.81] 



Related Passage 
Micmac Indians 
Short Answers 

Similarities and 
I Differences 



13.62 [13.78] 
(4.67) 



2.29 
(1.23) 



(224] 



14.57 {14.23] 
(4.^) 

2.67 [2.70] 
(1.78) 



20.48 [2036] 
(5.96) 

4.50 [433] 
(236) 



1732 [1733] I 
(621) 



338 
(2.40) 



[335] 



Unrelated Passage 
Landforms 
Short Answers 

Written Recalls 



1338 [1337] 
(537) 

12.08 (11.87) 
(10.60) 



13.17 [12.84] 
(5.66) 

8.83 [8.27] 
(7.80) 



1637 [16.47] 
(6.76) 

14.42 [14.17] 
(1138) 



14.87 (14.72)1 
(6.48) 

11.63 (113511 
(10.11) 







Observed M followed by Adjusted Af in bracket:; 




Standard Deviations in parentheses below Observed APs 
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ERLC 









Table 9 

Transfer to Independent Reading: Summaiy of Change Associated with 
Treatment Contrasts - Study 2 



Dependent 


Contrast 1 


Contrast 2 




Measure 


Change 


R^ Change 


XotalR^ 


P^Dcr Wasn Societies 








Short Answer 


.06* 


.19* 


.41 


. Essay 


.01 


.26* 


37 


Micmac Indian Society 








Short Answer 


.08*S 


.18' 


.63 


Essay 


.06* 


.16* 


.26 


Landforms 








Short Answer 


.01 


.08* 


33 


Free Recall 


.01 


.07* 


33 



F value significant 
S- ScEool X Coiitrast interaction 



Contrast 1: No Instruction (Independent Reading)/Instniction (Discrete and Integrative) 
Contrast 2: Discrete Instruction/Inte^ative Instruction 



%ablelO 



Means and Standard Deviations - Knowledge Frameworks - Study 2 



Dependent Measure 



Independent 
Reading 



2 

Discrete 



Integrative 



2&3 
Instruction 



Insect Society Schema. 
Topics 

Items 

Predictions 
Text Content 

"Text Organization 

Chart Completion 



132 
(1.17) 

2.23 
(238) 



1.05 
(.95) 

2.73 
(2.00) 

4.60 

(m 



11-30] 
12.231 

[1.00] 
(2.71) 
[4.61] 



.64 
(.95) 

1.77 
(2.16) 



132 
(1.04) 

3:64 
(1.89) 

3.52 
(2.00) 



[.651 
(1.761 

(1321 
(3.63) 
(3.521 



237 
(1.04) 

735 
(330) 



2.52 
(1.83) 

3.78 
(2.11) 

5.65 
(1.64) 



(2361 
(7341 

(2311 
(3.78] 
15.65] 



1.62 
(139) 

4.62 
(3.95) 



1.93 
(1.60) 

3.71 
(1.98) 

439 
(2.10) 



(1.621 
[438r 

(1.771 
(3.631 
(4391 



Observed M followed by Adjusted M in brackets 

* 

Standard Deviations in parentheses below Observed ATs 



ERIC 



Table 11 

Knowledge Erameworks: Summary of G hange Associated with Treatment 
Contrasts • Study 2 



Dependent 
Measure 

Insect Society Schema 

Topics 

Items 
Predictions 

Content 

Organisation 
Chart Completion 

F value significant 
S School X Contrast interaction 

Contrast 1: No Instruction/Instruction 

Contrast 2: Discrete Instructionlntegrative Instruction 



Contrast 1 Contrast 2 

Change Change Total R^ 



.01 37* .40 

.06* .40* SO 

.07 .04 .09 

•06* .2* .30 

.OOS .19* .31 



60 



Table 12 

Means* and Standard Deviations** • Knowledge Acquired • Study 3 



Visual 



Dependent Measure 


Representation 


Text 


Reference 


Multiple Choice Posttest 


37.67 


[38.31] 


35.25 


[34.84] 








\°- 1^} 




Booklet (1-12) 










Factual 


^1 


[.521. 


.47 


[.46] 




(.16) 




(.15) 




Explanation 




[.43] 


.32 


[.31] 




(.18) 




(.11) 




Application 


33 


[34] 


.27 


['.26] 




(.16) 




(.14) 




Total 


.49 


[.501 


.42 


[.41], 




(.17) 




(.13) 





* 

Observed M followed by Adjusted M in brackets 



Standard Deviations in parentheses 



Table 13 

Predicted Performance in Other Treatment Groups in Percentiles 



Discrete m Integrative m Integrative 

Dependent Measure Reading Only Reading Only ih Discrete 



Knowledge Acquisition 

Umtl 75 96 87 

Unit 2 70 99 94 

Week 2 75 99 92 

Units 84 99 84 
Booklet 

Factual 72 97 95 

Explanation 82 99 86 

Applii^ation 64 90 80 

Total ;82 99 92 

Transfer to Independent 
Reading 

Paper Wasps 

Short Answer 52 90 84 

Essay 56 93 96 
Micmac Indians 

Short Answer 54 92 89 

Essay 64 97 85 
Landforms 

Short Answer ^5____^.™^~«-^^ -70 — - — 74-- 

Free Recall 37 59 78 



Table 13 (Continued) 

Predicted Performance in Other Treatment Groups in Percentiles 



Discrete in Integrative in Integrative 

Dependent Measure Reading Only Reading Only in Discrete 



Knowledge Fram::works 
Insect Society Schema 

Topics 29 86 98 

Items 43 98 99 

Predictions 

Content 63 94 87 

Organization 68 71 53 

Chart Completion 31 68 86 



Note. Percentiles computed by lirst finding a z-score (Mg - M^/s-d.^) and then finding the 
appropriate point in the unit normal distribution. 
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Figure €aptions 

Figure 1. Study 2 treatment group means and contrasts on multiple choice posttest. 

Figure 2. Study 2 treatment group means and contrasts on Total Booklet scores. 

Figure 3. Study 2 treatment group means and contrasts on Closely Related transfer passage (Paper 
Wasps}* 

Figure 4, Study 2 treatment group means and contrasts on Related transfer passage (Micmac Indians). 
Figure 5, Study 2 treatment group means and contrasts on Unrelated transfer passage (Landforms). 
Figure 6. Means from the five treatment groups of Study 2 and Study 3. 
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